Data Engineering - Setup Development Environment HD

As part of this session we will see what is required to setup the environment to build Data Engineering Applications. For the complete material you can go to this link - http://discuss.itversity.com/t/data-engineers-setting-up-the-development-environment/19879 These sessions are conducted as part of Roadmap to Data Engineering Bootcamp series. Here is the link about the series. http://discuss.itversity.com/t/roadmap-to-cloud-and-data-engineering-bootcamp/19773 Before getting into details about setting up the development environment, we will also discuss below topics. * Quick Recap of Program Details. You can get complete details by going to this post. * Q&A about Program Here is the agenda about setting up Development Environment for Data Engineering. * Operating System - Linux based preferably Ubuntu or Mac * Virtual Box and Virtual Machine (Requires 16 GB RAM and i7 Quad Core) * Dual boot or Linux Only (Requires 4 GB RAM and i3, Recommended 8 GB RAM and at least i5) * Use Mac with out Linux * Overview of setup tools - brew for Mac and snap as well as apt for Ubuntu. * Configure password less login * Overview of primary programming language of the program - Python * Setup of Development Tools for Python based application development (PyCharm and Jupyter). PyCharm is mandatory. * Review of git based tools for Code Versioning * Setup of Data Sets for practice - git, Kaggle and other relevant platforms * Overview of Scala and IntelliJ for Scala based application development * Overview of apex.oracle.com to practice SQL Connect with me or follow me at https://www.linkedin.com/in/durga0gadiraju https://www.facebook.com/itversity https://github.com/dgadiraju https://www.youtube.com/itversityin https://twitter.com/itversity