Intelligently collecting data at the edge—intro to Apache MiNiFi

Intelligently collecting data at the edge—intro to Apache MiNiFi

Thursday, April 19
11:00 AM - 11:40 AM
Room II

Apache NiFi provided a revolutionary data flow management system with a broad range of integrations with existing data production, consumption, and analysis ecosystems, all covered with robust data delivery and provenance infrastructure. Now learn about the follow-on project which expands the reach of NiFi to the edge, Apache MiNiFi. MiNiFi is a lightweight application which can be deployed on hardware orders of magnitude smaller and less powerful than the existing standard data collection platforms. With both a JVM compatible and native agent, MiNiFi allows data collection in brand new environments — sensors with tiny footprints, distributed systems with intermittent or restricted bandwidth, and even disposable or ephemeral hardware. Not only can this data be prioritized and have some initial analysis performed at the edge, it can be encrypted and secured immediately. Local governance and regulatory policies can be applied across geopolitical boundaries to conform with legal requirements. And all of this configuration can be done from central command & control using an existing NiFi with the trusted and stable UI data flow managers already love.

Expected prior knowledge / intended audience: developers and data flow managers should have passing knowledge of Apache NiFi as a platform for routing, transforming, and delivering data through systems (a brief overview will be provided). The talk will focus on extending the data collection, routing, provenance, and governance capabilities of NiFi to IoT/edge integration via MiNiFi.

Presentation Video


Hortonworks, Inc.
アンディ・ロプレストは、Hortonworksの技術スタッフ シニアメンバーで、Hortonworks DataFlow チームに勤務しています。彼は、Apache NiFi、オープンソース、ロバスト、安全なデータルーティングと配信システムのコミッタおよび製品管理委員という役割を果たしています。アンディはアイデンティティ管理、TLS交渉、データ保護、アクセス制御、暗号化とハッシングを含む、NiFiの安全性に注力しています。また、安全な指令および管理、即時のデータ来歴と統制を含む、エッジデータ収集を推進する、サブプロジェクトのApache MiNiFiにも携わっています。彼はシンガポール、東京、メルボルン、ベルリン、シドニー、サンホセ、ブリュッセルで開催されたFOSDEM '17、そしてOpenIoT Summit 2017にてNiFiに関する講演を行っています。