Pydio v8

Purge Files Older...

Definitely remove files that were not modified since a given period.

This Flow automates the task of purging old files to maintain storage size under control. It can either "Delete" old files directly, or simply tag them so that user is informed that they are to be removed soon.

How It Works

The Flow works as described below:

  • Every days at 9PM,
  • List all files inside RootFolder that are older than XX days. This uses the specific modification date search criteria that takes values similar to ">3d" or "<1h".
  • Double check that file is not a .pydio hidden file (internal stuff)
  • Use a Conditional Filter checking for the job parameter to decide wether to definitely delete files, or to add a preset metadata.

When using the metadata feature (instead of real deletion), another job can be setup to crawl tagged files for actual deletion.

Parameters

Name Type Default Mandatory Description
RootFolder text pydiods1 false Root path where to look for files to purge.
FilesOlderThan integer 30 false (days) Look for files older than XX days
Action select, possible values: Mark for deletion (tag), Delete (delete) tag false Either mark for deletion with a tag, or permanently delete file.
MarkTagValue text to-be-deleted false If Action is "Mark for deletion", value of the tag to set.

Trigger Type

Scheduled

JSON Representation

{
  "Label": "Purge Files Older...",
  "Owner": "pydio.system.user",
  "Metadata": {
    "Description": "Definitely remove files that were not modified since a given period",
    "Icon": "mdi mdi-delete-forever",
    "TplCategory": "analytics",
    "Usage": "This Flow automates the task of purging old files to maintain storage size under control. It can either \"Delete\" old files directly, or simply tag them so that user is informed that they are to be removed soon.\n\n### How It Works\n\nThe Flow works as described below: \n\n * Every days at 9PM,\n * List all **files** inside **RootFolder** that are older than **XX days**. This uses the specific modification date search criteria that takes values similar to \"\u003e3d\" or \"\u003c1h\". \n * Double check that file is not a .pydio hidden file (internal stuff)\n * Use a Conditional Filter checking for the job parameter to decide wether to **definitely delete** files, or to **add a preset metadata**.\n\nWhen using the metadata feature (instead of real deletion), another job can be setup to crawl tagged files for actual deletion."
  },
  "Custom": true,
  "Schedule": {
    "Iso8601Schedule": "R/2020-03-03T20:00:00.471Z/PT24H"
  },
  "Actions": [
    {
      "ID": "actions.scheduler.log-input",
      "Label": "Collect Files",
      "NodesSelector": {
        "Query": {
          "SubQueries": [
            {
              "type_url": "type.googleapis.com/tree.Query",
              "value": "Ch17ey5Kb2JQYXJhbWV0ZXJzLlJvb3RGb2xkZXJ9fTABggEjPnt7LkpvYlBhcmFtZXRlcnMuRmlsZXNPbGRlclRoYW59fWQ="
            }
          ],
          "Operation": 1
        },
        "Label": "List Root Folder"
      },
      "Parameters": {
        "internalLogger": "false",
        "message": "{{.Node.Path}}",
        "taskLogger": "false"
      },
      "ChainedActions": [
        {
          "ID": "actions.scheduler.log-input",
          "Label": "Additional Filtering",
          "NodesFilter": {
            "Query": {
              "SubQueries": [
                {
                  "type_url": "type.googleapis.com/tree.Query",
                  "value": "OgYucHlkaW9wAQ=="
                }
              ]
            },
            "Label": "Exclude .pydio",
            "Description": "Filter out .pydio hidden files from selection."
          },
          "Parameters": {
            "fieldname": "{\"@value\":\"DurationDate\"}",
            "message": "",
            "taskLogger": "false"
          },
          "ChainedActions": [
            {
              "ID": "actions.tree.delete",
              "ActionOutputFilter": {
                "Query": {
                  "SubQueries": [
                    {
                      "type_url": "type.googleapis.com/jobs.ActionOutputSingleQuery",
                      "value": "akB7e2lmIGVxIC5Kb2JQYXJhbWV0ZXJzLkFjdGlvbiAiZGVsZXRlIn19dHJ1ZXt7ZWxzZX19ZmFsc2V7e2VuZH19"
                    }
                  ]
                },
                "Label": "Delete or Tag?"
              },
              "Parameters": {
                "fieldname": "{\"@value\":\"FreeCondition\"}",
                "ignoreNonExisting": "true"
              },
              "FailedFilterActions": [
                {
                  "ID": "actions.put-meta",
                  "Parameters": {
                    "json": "{\"usermeta-tags\":\"{{.JobParameters.MarkTagValue}}\"}"
                  }
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "MaxConcurrency": 10,
  "Parameters": [
    {
      "Name": "RootFolder",
      "Description": "Root path where to look for files to purge.",
      "Value": "pydiods1",
      "Type": "text"
    },
    {
      "Name": "FilesOlderThan",
      "Description": "(days) Look for files older than XX days",
      "Value": "30",
      "Type": "integer"
    },
    {
      "Name": "Action",
      "Description": "Either mark for deletion with a tag, or permanently delete file.",
      "Value": "tag",
      "Type": "select",
      "JsonChoices": "{\"tag\":\"Mark for deletion\",\"delete\":\"Delete\"}"
    },
    {
      "Name": "MarkTagValue",
      "Description": "If Action is \"Mark for deletion\", value of the tag to set. ",
      "Value": "to-be-deleted",
      "Type": "text"
    }
  ]
}
Back to top