Cognitive Classcognitiveclass.hashnode.net·Apr 13, 2021Which Data Career is Right for You - Data Scientist or Data Analyst or Data Engineer?Of the many data roles in the growing job market for data professionals, which data career is right for you? To help you answer this question, in this article we will compare what Data Scientists, Data Analysts, and Data Engineers do, what skills are...Discuss·1 like·360 readsData Science
Abhijit Barikcodewithabhijit.hashnode.net·Nov 20, 2022Hbase hive integrationProblem statement : Integrate Hive and HBase in a way that if you load data in hive table that should reflect in your HBase table and vice versa. Create a file in cloudera - vi testdata.csv 1, 'hyd'25000 2, 'blr', 30000 3,'kol',50000 we want to st...Discuss·1 like·53 readsineuron
krishna chaitanyakrishnavulchi.hashnode.net·Oct 29, 2022ETL Project for beginnersSimple ETL Web scrapping project where we extract data from a json, Transform the json data and Load it in one csv file Loading JSON file Transform JSON file Load json file into CSV Working json bank_data.json details Imports import glob import...Discuss·78 readsdata-engineering
VIVEK RAJYAGURUvivekrajyaguru.hashnode.net·Apr 2, 2023How to Set Up AWS DMS Service to Migrate Data from On-Premises to AWS with Example and Setup GuideAWS Database Migration Service (DMS) is a fully managed service that makes it easy to migrate databases to AWS quickly, securely, and seamlessly. DMS enables you to migrate your data from on-premises infrastructure to AWS with minimal downtime and di...DiscussAWS
Rajanand Ilangovanrajanand.hashnode.net·Mar 19, 2023Data EngineerData is ubiquitous in today's business landscape, and the ability to collect, process, and analyze it is critical to making informed decisions. This is where the role of a Data Engineer comes in. A Data Engineer is a professional responsible for desi...DiscussData Rolesdata engineer
Harshita Chaudharyharshita.hashnode.net·Feb 3, 2023Data Engineering ToolsEXECUTIVE SUMMARY Data engineers build pipelines that help companies collect, merge, and transform data to facilitate seamless analytics. They oversee the creation of an infrastructure design that enables modern data analytics. A Data engineer uses d...Discussdata
Sarvesh Kesharwanisarvesh42.hashnode.net·Jan 24, 2023The basic skills required to get a job as a machine learning engineer.1)python- basic_programming, data structures in python (list, tuple, dict) 2)libs in python- NumPy, pandas, matplotlib, seaborn 3) frameworks in python- flask 3)stats 4)mlDiscussData Science
Neyyan Jayeshjayeshblogs.hashnode.net·Dec 8, 2022Get started with Data EngineeringData engineering is the practice of designing, building, and maintaining data pipelines that extract, transform, and load data (ETL/ELT) from multiple sources, and make it available for analysis and decision-making. Data Engineers are responsible for...Discuss·38 readsdata-engineering
Abhijit Barikcodewithabhijit.hashnode.net·Nov 20, 2022Hbase hive integrationProblem statement : Integrate Hive and HBase in a way that if you load data in hive table that should reflect in your HBase table and vice versa. Create a file in cloudera - vi testdata.csv 1, 'hyd'25000 2, 'blr', 30000 3,'kol',50000 we want to st...Discuss·1 like·53 readsineuron
mani nekkalapudimaninekkalapudi.hashnode.net·Nov 12, 2022What is Data Engineering?Intro Hello all! Hope you are doing good. In the last couple of years, you might’ve heard a lot about Data Engineering. It surely gained a lot of buzz in recent times and… every company wanted data engineers. Needless to say, the demand for data engi...Discuss·74 readsData Engineering data
Naveen Kumar Vadlamudinaveenvadlamudi.hashnode.net·Nov 8, 2022State of Data Engineering and Its IssuesHello everyone, In this article, I will elaborate the Who is a Data Engineer and the existing types. Current State of Data Engineering. Plus the persisting issues in Data Engineering Domain. Okay a bit of introduction about me, I used to be a Clo...Discuss·84 readsData Engineering data-engineering
krishna chaitanyakrishnavulchi.hashnode.net·Oct 29, 2022ETL Project for beginnersSimple ETL Web scrapping project where we extract data from a json, Transform the json data and Load it in one csv file Loading JSON file Transform JSON file Load json file into CSV Working json bank_data.json details Imports import glob import...Discuss·78 readsdata-engineering
Cognitive Classcognitiveclass.hashnode.net·Apr 13, 2021Which Data Career is Right for You - Data Scientist or Data Analyst or Data Engineer?Of the many data roles in the growing job market for data professionals, which data career is right for you? To help you answer this question, in this article we will compare what Data Scientists, Data Analysts, and Data Engineers do, what skills are...Discuss·1 like·360 readsData Science
