Point and Click Data Flows

Apache NiFi

When integrating data, you need fast and easy ways to extract data from any source system and get it into your target system — a MarkLogic database.

Apache NiFi was built to automate the flow of data providing a nice drag and drop, configurable user interface. MarkLogic supports its processors built for Apache NiFi, and our integration with Apache NiFi makes it a great choice for getting data into MarkLogic.

With Apache NiFi, you can use out-of-the-box processors to create data flows from relational databases such as MySQL or Postgres, Apache Kafka data streams and other sources in the Hadoop ecosystem, and many other data sources. If a processor doesn’t exist, you can build your own or you can create templates for common data flow patterns, then publish and share them for others to benefit and collaborate.

Benefits of Apache NiFi

Developed by the NSA

10 years of development, with a focus on data security, provenance, and ease of use within teams.

Any Data Source

Ingest data into MarkLogic from relational, Hadoop, S3, and more. Over 50 data flow processors and it’s easily configurable and extensible.

Drag & Drop UI

Easy drag and drop UI makes it easier than ever to design the data flows to load data to MarkLogic and monitor the process.

How Fast Is It?

Watch this quick lightning talk where we demo how relational data can be loaded to MarkLogic in less than 5 minutes using Apache NiFi.

Intuitive Interface

This screenshot shows a simple process to get relational data into MarkLogic. A SQL query is executed to get data out of a relational system. Then, a NiFi processor converts the resulting Avro serialization to data formatted as JSON, and that data is put into MarkLogic.

Integrate Any Data Source

AMQP
Amazon SQS
Amazon SNS
Amazon S3
Azure Event Hub
Couchbase
CSV
DynamoDB
Elastic Search
Exchange Web Services
File System
FTP
Google Cloud Bucket

Grok Reader
HBase
HDFS
HTTP
Ignite Cache
IMAP
JMS
JSON Path Reader
Kafka
Mongo DB
MQTT
MySQL
Parquet

Pop3
Redis
RethinkDB
SFTP
SNMP
Solr
Spark
Splunk
SQL
TCP
Windows Event Log

Developer Resources

Get hands-on with Apache NiFi! Download the MarkLogic processors, quickstart guide, and other NiFi goodies on our Developer site.

Automate Your Dataflow

Feature-Rich and Built for the Enterprise

Connect With An Expert Explore All Features