Using components: MongoDB Source

In the MongoDB Source component, you define the parameters and credentials for accessing data in a MongoDB document database and which fields you will use in your package.

Source components are always the first components in a package.

source settings
  1. Define the parameters for connecting to your MongoDB collection as follows (for more information, see Allow Xplenty access to my MongoDB):
    • mongodb connection - either click the drop-down arrow and select an existing connection, or click (create new) to create a new connection.
    • source collection - the collection name to extract data from.
    • filter query - use MongoDB extended JSON to apply a filter on MongoDB's server side, or leave empty to query the entire collection. Note that $ is a special character that denotes a variable, so it must be escaped by a single back-slash in your extended JSON filter. For example:

      {"age":{"\$gt":24}}  - extract all documents where age is greater than 24.

      {"\$or":[{"price":{"\$exists":false}},{"price":{"\$eq":0}}]} - extract all documents where price is zero or does not exist.

      {"timestamp":{"\$gt":{"\$date":"2014-01-01T00:00:00.000Z"}}} - extract all documents where timestamp is greater than the date value 2014-01-01T00:00:00.000Z

Then click the Test Connection button to help check that the connection is good and that the source collection exists.

document mapping

  1. After defining the source settings, use the green Auto-detect Schema button to get the field names and data types, or the blue Show data preview button to preview the data and fill in the fields manually.
  2. Define the document keys you want to extract from the collection as follows:
    • Define the key in the document.
    • Define the alias you will use for the document key as a field in the data-flow.
    • Define the data type for the field. Use the following table when matching MongoDB data types to Xplenty data types.
MongoDB Xplenty
String String
32 Bit Integer Integer
64 Bit Integer Long
Double Double
Date DateTime
Object Json
Array Json Array
Boolean Boolean
ObjectID String

Creating packages

  1. Creating a new package
  2. Create a package from a template
  3. Working in the package designer
  4. Using Components: Facebook Ads Insights Source (Beta)
  5. Using components: File Storage Source
  6. Using components: Database Source
  7. Using components: Google AdWords Source
  8. Using components: NetSuite Source
  9. Using Components: Google Analytics Source
  10. Using Components: Google BigQuery Source
  11. Using components: Google Cloud Spanner Source
  12. Using Components: Bing Ads Source
  13. Using components: MongoDB Source
  14. Using components: Amazon Redshift Source
  15. Using Components: Rest API Source
  16. Using Components: Salesforce Source
  17. Using components: Select
  18. Using components: Sort
  19. Using components: Rank
  20. Using components: Limit
  21. Using components: Sample
  22. Using components: Join
  23. Using components: Cross Join
  24. Using components: Clone
  25. Using components: Cube and Rollup
  26. Using components: Union
  27. Using components: Filter
  28. Using Components: Window
  29. Using components: Assert
  30. Using components: Aggregate
  31. Using components: Distinct
  32. Using components: File Storage Destination
  33. Using components: Amazon Redshift Destination
  34. Using Components: Salesforce Destination
  35. Using components: Google BigQuery Destination
  36. Using components: Google Cloud Spanner Destination
  37. Using components: Database Destination
  38. Using components: MongoDB Destination
  39. Using components: Snowflake Destination (beta)
  40. Using and setting variables in your packages
  41. System and pre-defined variables
  42. Validating a package
  43. Using pattern-matching in source component paths
  44. Using ISO 8601 string functions
  45. Using Expressions in Xplenty
  46. Xplenty Functions

Feedback and Knowledge Base