Using pattern-matching in source component paths

In a file storage source component, a source path can be composed of regular characters and special pattern-matching characters as follows:

? - Matches any single character.

* - Matches zero or more characters.

[abc] - Matches a single character from character set {a,b,c}.

[a-b] - Matches a single character from the character range {a...b}. Note that character a must be lexicographically less than or equal to character b.

[^a] - Matches a single character that is not from character set or range {a}. Note that the ^ character must occur immediately after the opening bracket.

\c - Removes (escapes) any special meaning of character c.

{ab,cd} - Matches a string from the string set {ab, cd}

{ab,c{de,fh}} - Matches a string from the string set {ab, cde, cfh}

Examples

/2013-01-{01,02,03}/impressions/* matches any object in /2013-01-01/impressions/*, /2013-01-02/impressions/* and /2013-01-03/impressions/*

/201[0-9]/01/* matches any object in /2010/01/*, /2011/01/*, /2012/01/* , ... , /2019/01/*

Creating packages

  1. Creating a new package in New Xplenty
  2. Creating a workflow
  3. Working in the new package designer
  4. Validating a package
  5. Using components: Amazon Redshift Source
  6. Using components: Bing Ads Source
  7. Using components: Database Source
  8. Using components: Facebook Ads Insights Source
  9. Using components: File Storage Source
  10. Using components: Google Adwords source
  11. Using components: Google Analytics Source
  12. Using components: Google BigQuery Source
  13. Using components: Google Cloud Spanner Source
  14. Using components: MongoDB Source
  15. Using components: NetSuite Source
  16. Using components: Salesforce source
  17. Using components: Rest API Source
  18. Using components: Aggregate Transformation
  19. Using components: Assert Transformation
  20. Using components: Clone transformation
  21. Using components: Cross Join Transformation
  22. Using components: Distinct Transformation
  23. Using components: Filter Transformation
  24. Using components: Join Transformation
  25. Using components: Limit Transformation
  26. Using components: Rank Transformation
  27. Using components: Select Transformation
  28. Using components: Sort Transformation
  29. Using components: Union Transformation
  30. Using components: Window Transformation
  31. Using components: Sample Transformation
  32. Using components: Cube transformation
  33. Using components: Amazon Redshift Destination
  34. Using components: Database Destination
  35. Using components: File Storage Destination
  36. Using components: Google BigQuery Destination
  37. Using components: Google Spanner Destination
  38. Using components: MongoDB Destination
  39. Using components: Salesforce Destination
  40. Using components: Snowflake Destination (beta)
  41. Using Components: Rest API Destination
  42. Using and setting variables in your packages
  43. System and pre-defined variables
  44. Using pattern-matching in source component paths
  45. Using ISO 8601 string functions
  46. Using Expressions in Xplenty
  47. Xplenty Functions

Feedback and Knowledge Base