This repo documents my learning process for data pipeline construction with Airflow, and engaging in batch processing with Spark and streaming data with Kafka.

The Colonial Pipeline has temporarily shut its main gasoline line – America’s largest fuel pipeline – because of leak in Georgia, the pipeline’s operator and local officials said.

The snippet bellow is a basic example showing a custom segment which simply adds a stage with two manual approval steps into the pipeline and allows you to optional give this step a name. The main ...

The 120-mile-long, 12-inch-wide pipeline links Exxon Mobil Corp. and Saudi Basic Industries Corp.’s (SABIC) ethane cracker in Gregory to storage in Markham. The cracker can produce up to 1.8 ...

Kayne is reportedly "terrified to return to the U.S." because of the charges against Sean "Diddy" Combs and his involvement ...

A new law that waives the Basic Skills Praxis exam for some aspiring teachers has been welcomed with disparaging headlines ...

Historical Prices for Plains All American Pipeline L.P. Plains All American Pipeline L.P. Analyst Data Plains All American Pipeline L.P. Analyst Opinions Plains All American Pipeline L.P ...