Project on hadoop using PIG,HIVE,SCALA ,PySpark or Python

Hey, I'd love to work on the python part of this project. please reach out to me with further details. I'm looking forward to working with you, Vedant

Highly effective Big Data Engiener with over 25 years of experience. I have extensive Python / Spark experience both in PySpark and Scala also in MLLib. I checked your Scala code and should be able to convert it to PySpark. TECHNICAL SKILLS • Big Data (Hortonworks and Cloudera) – Spark(PySpark, Scala), Kafka, Hive,Impala, NiFi, HDFS, Sqoop, Ranger, Yarn, Solr, SAM, Schema Registry, SuperSet, Druid • Language: Python, Scala, R, JavaScript • Data Visualization – Tableau, PowerBI, OBIEE, DOMO • Plunk & ELK Stack – ElasticSearch, Logstash, Filebeat, Kibana • AWS – S3, RefShift, DynamoDB, Athena, Kinesis, EMR, Aurora, Glue • Azure – Data Warehouse, Polybase, SQL Server, HDInsight, SSIS, SSAS • ETL – Informatica Power Centre, Informatica Big Data Management (BDM), SSIS • Data Science & Engineering – R / RStudio / SparkR Packages: dplyr, ggplot2, stringr, plyr, carrat, SparkR, NLP, tibble, TensorFlow, curl, Python / PySpark, MLLib • Libraries: MLLib, NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit-Learn • DBMS / OLAP – Oracle, SQL Server, TeraData, MySQL, Postgres, Essbase, SSAS • Data Modelling – Kimball, Vault • Machine Learning / Statistical Modelling - Linear Regression, ?Logistic Regression, Classification and Regression Trees, Naive Bayes, ?K-Nearest Neighbors

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

my name is imran working as a Hadoop administration i will give solutions to your project problem i have work experience on deployment of production gread clusters

Experience in Hadoop framework, Script designing in Spark and Python. Expertise in Analysis, Design, Development, Implementation and Support of Data Warehousing using Big Data. Hands on experience in Data Transformation using Python, Pandas. Pyspark, Hive, identifying and resolving performance issues in various levels like Hive Performance issues, Spark running performance issues, etc. Performs data processing using Hadoop, Spark, Python, Hive, and Sqoop Sound exposure in directly working with clients to understand and analyze the business requirements and propose effective solutions. Independently developed multiple Spark script using Python and pandas to process data . Involved in creating Hive tables, loading data and writing hive queries which will run internally in Pyspark way. Strong Knowledge of Hadoop and Hive and Hive's analytical functions. Created schema in Hive with performance optimization using bucketing & partitioning Solid understanding of the Hadoop file distributing system Hands on experience in IDE tools like Eclipse, Pycharm, Jupyter Notebook.

I have a lot of experience in development. Ready to complete your task.

Hello. I have read your requirements carefully and understood what you want. i have experience in some of the frameworks mentioned especially spark. I’d love to hear more details from you. Best Regards

I am having more than 5years of exp in power bi, azure data factory,python,spark,usql,adls,azure dw,sql,blob,infra,aws,redshift,power bi,sql server,data bricks,postgres,sql server,columnar databases,azure analysis services,big data implementation,azure batch,azure logic apps, machine learning ,neural networks (Ann ,cnn and rnn) and aws lambda. Good experience in technical architecture and consulting . Designed various questions paper for screening for various corporates for Azure and Power bi certified professional with 5 plus years of exp in data and analytics . worked on various engagements and scenarios. I have extraordinary communication skill and take any task very seriously. A true professional with zero tolerance towards quality.

Hello , I am a software developer who is proficient in Hive , Python , Scala and PySpark.I believe that I can assist you with this project .Be assured that with my skills and experience , I will add value in any way I can. I am looking forward to the start of a great working relationship. Thank you.

I am having experience of working on the Hadoop ecosystem using several tools including Hive, Apache PIG, MapReduce and PySpark. It's my area of interest to work on the Bigdata tech-stack.

I am proficient in pyspark datascience and python

Hi I am new to freelancing but i am a Big Data Senior Consultant with reputed organization with total 6.4 years of experience in Data engineering Analysis and Development. He has strong background in developing Real-Time, Batch and mix workloads on a big data platform handling high volumes, variety and velocity of data. He provides Hadoop/Spark focused infrastructure provisioning, demonstrations, evaluations, proof of concept support and advance analytics over big data implementations. Always enthusiastic to learn new technologies and give best to the designated assignments. Please Replay with problem statement Thanks

Dear Hiring Manager, I have seen your post regarding the opportunity for expert to work on hadoop,Hive,spark with scala and as i am interested i would like to apply for that. I have total of 4.4 years of hands on experience as Big Data engineer and as a part of that i have been part of multiple projects in hadoop and spark. In hadoop and spark i have experience in ecosystems such as hdfs,hive,map reduce,pig,sqoop,sparkRDD,dataframe,datasets etc with AWS services such as s3,lambda,step functions,ec2,redshift etc. Please let me know the exact requirement so that i can start work on that asap. Thanks, Harsh