The IOT revolution brings along with it a glut of sensor data. The sensor data glut in turn brings with it a set of challenges in statistical modeling and scalable machine learning for sensor data analysis. This is an overview of sensor data analysis. We look at sensor characteristics such as bias, linearity, stability, precision and accuracy. We also understand gage analysis approaches, time series analysis in the univariate and multivariate forms, such as AR and VAR models. We look at caveats
Apache Nifi is a recent addition to the family of distributed data processing frameworks. Nifi provides a reliable, UI based mechanism to transport, filter and enrich data across multiple systems. What are some of the unique features of Nifi and how well does Nifi weigh out, in comparison to or in complement to the other data transfer/processing frameworks like Flume,Kakfa, etc?