Overview / Usage

In this project, alarm data are captured from the various machines likes Big plants, grids, ships, and some important pattern/rules are identified based on the collected alarm/event data. The rules are made up of the critical events and their associated events. After identification of the rules, the streamed events are analysed corresponding to each rules and the various metric of rules are calculated and the results are visualized on the dashboard. This project has two parts: batch analysis and real time analysis. The project is developed on distributed cluster using Spark, Spark streaming, Flume, and the results are visualized with Redis, Node.Js, and Google chart.

Methodology / Approach

In this project, alarm data are captured from the various machines likes Big plants, grids, ships, and some important pattern/rules are identified based on the collected alarm/event data. The rules are made up of the critical events and their associated events. After identification of the rules, the streamed events are analysed corresponding to each rules and the various metric of rules are calculated and the results are visualized on the dashboard. This project has two parts: batch analysis and real time analysis. The project is developed on distributed cluster using Spark, Spark streaming, Flume, and the results are visualized with Redis, Node.Js, and Google chart.

Technologies Used

Hadoop, Spark, Spark Streaming, Flume, Node.Js, Python