Using pattern-matching in source component paths

In a file storage source component, a source path can be composed of regular characters and special pattern-matching characters as follows:

? - Matches any single character.

* - Matches zero or more characters.

[abc] - Matches a single character from character set {a,b,c}.

[a-b] - Matches a single character from the character range {a...b}. Note that character a must be lexicographically less than or equal to character b.

[^a] - Matches a single character that is not from character set or range {a}. Note that the ^ character must occur immediately after the opening bracket.

\c - Removes (escapes) any special meaning of character c.

{ab,cd} - Matches a string from the string set {ab, cd}

{ab,c{de,fh}} - Matches a string from the string set {ab, cde, cfh}

Examples

/2013-01-{01,02,03}/impressions/* matches any object in /2013-01-01/impressions/*, /2013-01-02/impressions/* and /2013-01-03/impressions/*

/201[0-9]/01/* matches any object in /2010/01/*, /2011/01/*, /2012/01/* , ... , /2019/01/*

Creating packages

  1. Creating a new package
  2. Create a package from a template
  3. Working in the package designer
  4. Using Components: Facebook Ads Insights Source (Beta)
  5. Using components: File Storage Source
  6. Using components: Database Source
  7. Using components: Google AdWords Source
  8. Using components: NetSuite Source
  9. Using Components: Google Analytics Source
  10. Using Components: Google BigQuery Source
  11. Using components: Google Cloud Spanner Source
  12. Using Components: Bing Ads Source
  13. Using components: MongoDB Source
  14. Using components: Amazon Redshift Source
  15. Using Components: Rest API Source
  16. Using Components: Salesforce Source
  17. Using components: Select
  18. Using components: Sort
  19. Using components: Rank
  20. Using components: Limit
  21. Using components: Sample
  22. Using components: Join
  23. Using components: Cross Join
  24. Using components: Clone
  25. Using components: Cube and Rollup
  26. Using components: Union
  27. Using components: Filter
  28. Using Components: Window
  29. Using components: Assert
  30. Using components: Aggregate
  31. Using components: Distinct
  32. Using components: File Storage Destination
  33. Using components: Amazon Redshift Destination
  34. Using Components: Salesforce Destination (Beta)
  35. Using components: Google BigQuery Destination
  36. Using components: Google Cloud Spanner Destination
  37. Using components: Database Destination
  38. Using components: MongoDB Destination
  39. Using and setting variables in your packages
  40. Validating a package
  41. Using pattern-matching in source component paths
  42. Using ISO 8601 string functions
  43. Using Expressions in Xplenty
  44. Xplenty Functions

Feedback and Knowledge Base