Senior Assoc, Application Developer (Data Engineering), Middle Office Technology - Finance Platform, Group Technology

Business Function

Group Technology enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group Technology, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Responsibilities

• Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem.

• Perform performance tuning of SQL and Spark ETL processing to optimize system efficiency and reduce latency.

• Implement batch automation using Shell scripts and REST APIs, including job triggering and result parsing.

• Manage data storage, ingestion, and retrieval processes using HDFS and Parquet

• Develop robust scripts using Shell, Python, and Scala to automate operational workflows and system integrations.

• Utilize AWS products, such as S3 Storage, for cloud-based data management and integration.

• Troubleshoot, debug, and resolve complex technical issues within Linux/Unix environments.

Requirements

• Proven experience in application development within a large-scale enterprise technology environment.

• Strong technical expertise in Hadoop, HDFS, Hive, and Impala.

• Proficiency in Spark (Scala/Java) and SQL.

• Hands-on experience with data serialization and storage formats including Parquet

• Demonstrated ability in the performance tuning of SQL and Spark ETL processing.

• Strong command of Linux/Unix systems and command-line tools.

• Expertise in scripting using Shell, Python, and Scala.

• Experience in batch automation using Shell scripts and REST APIs, including triggering and result parsing.

• Familiarity with cloud technologies, specifically AWS products such as S3 Storage.

• Strong problem-solving skills and a can-do attitude, with the ability to develop solutions.

Location

DBS Asia Hub

Job

Technology

Schedule

Regular

Employee Status

Full time