Search by job, company or skills

INNOVA SOLUTIONS

AWS Data Engineer with AWS,SQL,Pyspark,Glue,SCD

Save
  • Posted a month ago
  • Over 100 applicants
Quick Apply

Job Description

  • 7-10 yrs exp with Python , Pyspark , SQL, AWS (S3,EMR,EC2,glue,redshift,lamba), Snowflake
  • S3 life cycle ,DPU in glue ,database connection from glue job, lambda , 100 files in Athena, Spark entry point ,Data Frame Dynamic Frame, Spark Join strategies ,Broadcast and Accumulator , DAG And Lineage, Start snowflake schema, SCD type 2 ,Orchestration ,Airflow
  • Airflow Operators, Semi Anti join ,Windows Functions ,Decorators, deep and shallow, Hashing Algo , Data skewness.

About Company

Job ID: 107708683

Similar Jobs

Pune, India

Skills:

Amazon S3AWS CloudFormationAWS GlueApache SparkAWS CloudWatchPythonAWS Glue StudioAWS DevOps toolsAWS Glue ETL

Chennai, India

Skills:

data wrangling Data pipelineConcurrencyCore PythonPysparkException HandlingApisData LoadingDebuggingOopGitNumpyPandasRestful ServicesUnit testsDecoratorsDataframesLambda FunctionsError handlingParallel ProcessingDB connectivityGen AIVector operationsapply map functionsapplymap

Pune, India

Skills:

change data capture PostgreSQLData WarehousingSQL ServerInformaticaSSISSqlELTAzure Data FactoryDataStageMySQLOracleAzureAWSEtlAirflowcloud platformsBatch Processingdimensional modellingControl-MSQL Agent

Chennai, India

Skills:

data wrangling ConcurrencyData PipelinePythonPysparkApisDebuggingOopNumpyGitPandasException HandlingData LoadingRestful ServicesDecoratorsDataframesParallel ProcessingLambda FunctionsError HandlingVector OperationsApplymapGen Agentic AIApply Map FunctionsUnit TestsDB Connectivity

Hyderabad, India

Skills:

RDSPysparkAWS GlueDynamodbEmrSqlLambdaCloudwatchIamSqsSnsPythonAWSLake FormationCloudTrail