JPC-221368 - Apache Spark
Job Posted: May 16, 2024 | Total views: 1

Job Description:

• Job Description

   

  JC: 1942909

   

  Budget :170K

   

  Location: Bangalore ,Hyderabad , Chennai ,Pune

   

   

   

   

   

  JD:

   

   

   

  Apache Spark

  
  
  

  • Experience with standard big data eco-system technologies (either CDH or HDP),  knowledge of distributed systems for computing and data storage

   

  • Should have experience working on Hadoop, Hive, HBase, Sqoop, Oozie, Kafka, Spark (Python/Scala)

   

  • ETL workflow development and building Data pipelines using Spark(Python/Scala)

   

  • Excellent knowledge of UNIX shell script or PL/SQL stored procedures is required

   

  • Develop Hive QL for analysing all semi-structured/unstructured/structured data flows.

   

  • Should have knowledge of Table definitions, file formats, UDF , Data Layout ( Partitions & Buckets), Debugging & performance optimizations.

   

  • Knowledge on distributed processing, data warehouse concepts, NoSQL, huge amount of data processing Knowledgeable on RDBMS, Testing, Data management principles, Data mining, Data modelling

   

  • Excellent communication skills verbal and written

   

  • Should be able to perform well in pressure situations

   

  • Team Player

  
  
  

   

   

   

About Company :
Purview is a leading Digital Cloud & Data Engineering company headquartered in Edinburgh, United Kingdom having a presence in 14 countries India (Hyderabad, Bangalore, Chennai and Pune), Poland, Germany, Finland, Netherlands, Ireland, USA, UAE, Oman, Singapore, Hong Kong, Malaysia and Australia.

We have a strong presence in UK, Europe and APEC, providing services to Captive Clients (HSBC, NatWest, Northern Trust, IDFC First Bank, Nordia Bank etc) in fully managed solutions and co-managed capacity models. Also, we support various top IT tier 1 organisations (Capgemini, Deloitte, Wipro, Virtusa, L&T, CoForge, TechM and more) to deliver solutions and workforce/resources.

Company Info: