Data Visual Modeling: Workflow#

Note

Workflow is an idea at present.

What is the Workflow?#

Workflow is the visual programming, it can help us change the way of work from writing code to dragging components. The following graphs show some software I have met. And each of them is facing a specific field.

  • Scratch: programming enlightenment education

  • LabVIEW: hardware accessing and controlling

  • ArcGIS: GIS Platform

  • FME: spatial data processing

  • Orange: machine learning

If you know about them, you would get the programming experience is totally different.

  • Fast

  • Efficient

  • Convenient

  • Understandable

Scratch

LabVIEW

ArcGIS workflow

FME workflow

Orange workflow

Question & Answer#

How Do Pipeline with Workflow?#

The Pipeline could be the engine of Workflow, and Workflow is the UI of Pipeline.

How Do Workflow with AutoML?#

Workflow is the human intelligence, AutoML is the machine intelligence.

So Workflow + AutoML could combine intelligence of both human and machine.

What is Different from Similar Software?#

The core of Data Mining work is Data Analysis. But the most costing time is Data Preprocessing the steps before Data Analysis.

There are a lot of Data Analysis tools could do Data Visualization, Data Analysis and Machine Learning such as:

But Data Preprocessing still needs to write code.

A Example of Workflow#

Store data pipeline

This is a store data complete pipeline what we have seen at Transformer and Pipeline Quickstart.

All jobs in Pipeline, from Data Cleaning to Data Preprocessing, from Feature Engineering to Regression.

With the helping of Pipeline, the total work could easily be drawn into workflow.

This workflow is clearly described.