Starting a new professional journey after the age of forty is not easy, especially in the field of programming when you have never studied it before.
I had a class on algorithms while studying environmental engineering, between 2011-2012, which was the closest I got to programming.
I worked in finance, completed my engineering degree, and then ventured into digital marketing, where I was able to apply logical thinking and my love for data.
I took a data analysis course via Google (Coursera) in 2023 and had my first contact with SQL, the R language, Tableau and data processing. I practiced data processing in Excel and Google Sheets.
It was curiosity and the desire to learn more about how data analysis can help solve problems that led me to the course I am currently taking. The combination of big data, organized within a company, brings value and optimization to work and decision-making processes.
I am currently enrolled in the Big Data Development course at Collège Bois de Boulogne in Montreal. The goal is to become a data architect or engineer, working with excellent tools that will make me highly sought after in the job market.
I must admit that the course is not easy. It requires dedication and many hours of study to assimilate the extensive content and varied tools. In the first session (fall session) from October 9, 2023, to February 28, 2024, we covered three subjects:
- Ecosystem for Big Data Solutions Development
- Programming Techniques for Big Data Solutions
- Big Data Solutions Architecture
We learned in general about data pipelines, data processing, business models, business value, data warehousing, ERP, Hadoop, and the origins and evolution of tools for data extraction, acquisition, and processing.
My brave classmates and I (there were 22 of us on the first day, which dropped to 18, and now we are down to 13) had hands-on experience with tools such as Docker (with container notions), Kafka, Airflow, Hbase, and Spark (with basic knowledge). We also learned Python programming (I confess I am still at the beginner level), database concepts, ETL to ELT transitions, and AWS S3.
We understood the importance of using data to enhance a company’s value by obtaining information from secure sources with minimal errors and biases, enabling well-defined decision-making using the best tools for each specific situation.
It is crucial to remember that a company’s goal is to increase profits while minimizing costs, so knowing exactly which systems, algorithms, and cloud services to use to scale profits and acquire excellent data analysis and organization capabilities is essential, whether dealing with continuous or intermittent data streams.
Currently, we are in the winter session, which will run from February 26, 2024, to June 28, 2024. The subjects for this session include:
- Data Acquisition Techniques
- Database Query Language
- Implementation of Cloud Solutions for Data Storage
My Big Data Development course at Collège Bois de Boulogne will conclude in April 2025.
I am confident that upon completion, I will take pride in my journey and that of all my classmates, with our struggles and dedication to studying, falling in love with this vast and exploratory world of Big Data.
