Datawarehouse Expert
Aktualisiert am 06.06.2024
Profil
Freiberufler / Selbstständiger
Remote-Arbeit
Verfügbar ab: 06.06.2024
Verfügbar zu: 100%
davon vor Ort: 100%
Teradata
Databricks
IBM
SQL
PYSPARK
PYTHON
ETL
JIRA
REST
IBM InfoSphere DataStage
SSAS
SSIS
SSRS
POWER BI
Informatica PowerCenter
BTEQ
Banking/Finance
Telekommunikation
MIGRATION
Qualitymanagement
Acceptance Test
DataDomain

Einsatzorte

Einsatzorte

Zürich (+200km)
Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

2 years 10 months
2021-08 - now

Implemented the connection and continuous sourcing

Senior Data engineer (Solution Architect ) Teradata Oracle SAP
Senior Data engineer (Solution Architect )
  • Implemented the connection and continuous sourcing of the AWS S3 storage and Azure Synapse platform with data from the on premises source systems ( Teradata, Oracle, SAP )
  • Gathered requirements and implemented on Teradata framework for Request for deletion/anonymization and Request for Information projects
  • Created proof of concept for the migration of the on premises Datawarehouse on AWS cloud and Databricks
  • Generated samples of synthetic anonymized data for testing the cloud proof of concepts based on production environment.
  • Optimized long running queries and Etl processes on Teradata and Microstrategy.
  • Supported on the daily production run
  • Configured and maintained pipelines based on Elasticsearch engine on Azure cloud ( log monitoring, cleansing and modeling to the local Datawarehouse)
  • Created dashboards based on the Elasticsearch feeds
  • Converted automatically existing Informatica Power Center mappings in Databricks notebooks by using python and REST API
  • Implemented Data Quality Framework on IDQ
  • Created pipelines for sourcing the local Teradata DWH using REST API 
Teradata Oracle SAP
SwissCom
Bern, Switzerland
7 years
2015-01 - 2021-12

various projects

  • Enriched my business knowledge on Banking by participating on projects like (IFRS9, Securities, Anacredit, CRS, FATCA, BANKENPAKET).


2015 - 2021

  • Supported successfully the continuous integration of regulatory reporting requirements during the period with Quarterly releases


2020 - 2020

  • Implemented following the detailed analysis of the Business needs a new Data quality framework which is able to identify and automatically correct data quality issues coming from the interfaces delivered by local Austrian or CEE subsidiaries This was designed to be Metadata Driven and with custom business checks on Teradata SQL using Stored procedures and python scripts The final results were reported via Power BI.
  • With this framework the need of monthly manual adjustments by Business was decreased by 70% percent and the Quality of the deliveries towards the regulators was improved as well .


2017 - 2017

  • During the Anacredit Project identified and implemented in short time gaps related to ECB requirements by creating an application which was performing comparisons of billions of records between the deliveries towards ECB and the return interface provided by the local Austrian regulator
  • The specific solution was developed by using a combination of SSAS -python and Teradata SQL

Bank Austria(
5 years 7 months
2016-01 - 2021-07

project implementation strategy

Senior Data Engineer
Senior Data Engineer
  • Collected Requirements and provided effort estimation , project implementation strategy as well as Technical solution documentation for 35 Regulatory projects for Bank Austria and Local Subsidiaries.
  • Migrated existing (on premises ) DataMarts to Azure Databricks(redirected source files to Azure Blob storage, Converted existing datastage and SSIS jobs to Databricks notebooks and redefined the scheduling of the jobs by scheduling Databricks notebooks withing Azure datafactory (ADF) pipelines.
  • Converted the existing parquet files in Delta and optimized the storage and performace of the spark notebooks.
  • Acting as Lead Data Engineer and coaching implementation teams on parallel project activities by providing training ,guidance and support on complicated development issues either on Teradata SQL or on Microsoft BI ( SSIS-SSAS-Power BI) or by implementing Data Quality checks( using PL-SQL stored procedures on Oracle -Teradata)
  • Working closely with Business Units (CDO -Regulatory Reporting -Finance and Risk) in analyzing new Regulatory reporting requirements ensuring continuous integration of new features on Production environment.
  • By Using Unicredit internal DEVOPS platform(Gandalf,HPQC,SVN) Analyzed interdependencies between parallel on going projects,defined IT test cases and Production deployment process ensuring "smooth" transition from QA to Prod.
  • Reviewing designs and code developed during full life cycle of each project(DEV-SIT-UAT) and checking quality of results by performing regression tests.
  • Providing post go live support-Production Incidents fixing and collecting - proposing improvements for upcoming projects .
  • Designed Meta data driven SSIS packages by using BIML and MS Visual studio
Unicredit Bank Austria
Vienna, Austria
4 years 10 months
2011-03 - 2015-12

Implemented new requirements on Teradata Financial Model

Lead Data Warehouse Technical Analyst SQL PL SQL
Lead Data Warehouse Technical Analyst
  • Reviewed Functional specifications for new requirements and proposed changes to business analysts.
  • Implemented new requirements on Teradata Financial Model (FSLDM) using SQL ,PL SQL ,IBM DataStage. (starting from parsing data from source systems with structured and unstructured format, staging (Data Stage ), transformations (SQL), calculations (SQL-DAX -MDX) up to delivery of reports to business )
  • Participated on Large scale Migration projects from Oracle to Teradata.
  • Preparing go live and post go live activities and supporting operations team on incident fixing.
  • Providing training to junior developers on Teradata SQL,Performance optimization and Development Guidelines.
  • Performance optimization of approximately 2000 Queries on Teradata by identifying low performing queries (using Explain PLAN ,dbcdbqlog). By this optimization activity and by identifying bottlenecks in the ETL pipeline scheduling nightly batch load was improved by 4 hours
SQL PL SQL
Unicredit Bank Austria
Vienna, Austria
1 year 3 months
2010-01 - 2011-03

Training junior developers

Data Engineer
Data Engineer
  • Supporting Teradata Customers 5 DWH projects across Europe ( Unicredit Italy, Lufthansa, BMW) by fixing complicated issues (like surrogate key definition,performance optimization,data mart design)
  • Training junior developers on SQL and Data Warehousing 
  • Performed large-scale data Migrations to Teradata FSLDM
  • Addressed ad hoc analytics requests and facilitated data acquisitions to support internal projects, special projects and investigations
DWH Consultant Teradata Corp
Prague-Munich-Milan, CZ
6 years
2004-01 - 2009-12

Implemented and Designed Business intelligence Solutions

Microsoft Business Intelligence Engineer SSAS SSRS SSIS
Microsoft Business Intelligence Engineer
  • Implemented and Designed Business intelligence Solutions on 5 Customers (Otis, Carrefour, Rakes LTD,Pinko,Soho-Soho) using Microsoft Business Intelligence Stack (SSAS, SSRS, SSIS)
  • Performed Migrations from old DOS applications to Microsoft ERP and CRM
  • Designed custom solutions in SQL server for Customer Loyalty systems and in connection with Microsoft CRM and ERP
  • Implemented SSIS ETL packages for transferring and loading data from multiple subsidiary databases(retail POS) to Central ERP SQL database
  • Developed SSIS packages for updating automatically POS systems and Electronic Self Labels
  • Barcode design
SSAS SSRS SSIS
various
Athens, Greece
4 years 5 months
2000-01 - 2004-05

migration of data from DOS based application

LogicDIS ERP Developer
LogicDIS ERP Developer
  • Responsible for migration of data from DOS based application to SQL server ERP.
  • Responsible for maintenance of ERP system and for providing support on the central warehouse and the subsidiaries of the company.
  • Infrastructure maintenance( 10 servers ) Developing consolidated reports for warehouse inventory firstly on Seagate crystal Reports and afterwards on Microsoft SQL server.
  • Assisting on designing of Bar codes and pricing system.
  • Collaborated with other developers to identify and alleviate software errors and inefficiencies.
Alouette Clothing Industry
Athens, Greece

Aus- und Weiterbildung

Aus- und Weiterbildung

4 years 1 month
1990-09 - 1994-09

European Economic Studies

Bachelor of Science, Athens University Of Business And Economics - Athens
Bachelor of Science
Athens University Of Business And Economics - Athens

Position

Position

Data Engineer

Kompetenzen

Kompetenzen

Top-Skills

Teradata Databricks IBM SQL PYSPARK PYTHON ETL JIRA REST IBM InfoSphere DataStage SSAS SSIS SSRS POWER BI Informatica PowerCenter BTEQ Banking/Finance Telekommunikation MIGRATION Qualitymanagement Acceptance Test DataDomain

Produkte / Standards / Erfahrungen / Methoden

Profile

An experienced Senior Data Engineer with a strong combination of technical and business analysis skills. Having a well proven record of achievements within challenging environments and specialized for the past 15 years in the Data Warehouse area of Financial Industry. Expertise in delivering on time and on budget with high quality demanding Regulatory -ALM Risk requirements. Experienced in translating the business requirements in high performing technical solutions and leading multi- national software developer teams. Acting as the single point of contact between Business IT Development teams/Operation teams to manage and coordinate the activities required by all key stakeholders in order to deliver the required solution within tight timelines.


Skills

Data Warehousing

  • Teradata
  • MS SQL


Traditional ETL

  • Datastage
  • SSIS
  • Teradata Tools


Cloud ETL

  • Azure Data Factory
  • Databricks
  • Synapse


Data Visualization

  • SSAS
  • SSRS
  • PowerBI
  • Azure Synapse


Data Analysis

  • Finance 
  • Banking
  • Telco


Additional Skills

  • Teradata Utilities 
    • Fast load
    • Fast Export
    • TPT
  • SQL Performance tuning
    • MSSQL
    • TERADATA
    • ORACLE
  • Stored Procedures development
    • SQL 
    • PL-SQL
  • Triggers 
    • SQL 
    • PL-SQL
  • BIML automatic SSIS package generation
  • Tortoise SVN, GIT, GITHUB
  • Unix scripting
  • Microsoft ERP and CRM customization

Programmiersprachen

SQL
PL-SQL
Python
Pandas
REST API


Datenbanken

3NF
Modeling
Data Vault
Modeling



Einsatzorte

Einsatzorte

Zürich (+200km)
Deutschland, Schweiz, Österreich
möglich

Projekte

Projekte

2 years 10 months
2021-08 - now

Implemented the connection and continuous sourcing

Senior Data engineer (Solution Architect ) Teradata Oracle SAP
Senior Data engineer (Solution Architect )
  • Implemented the connection and continuous sourcing of the AWS S3 storage and Azure Synapse platform with data from the on premises source systems ( Teradata, Oracle, SAP )
  • Gathered requirements and implemented on Teradata framework for Request for deletion/anonymization and Request for Information projects
  • Created proof of concept for the migration of the on premises Datawarehouse on AWS cloud and Databricks
  • Generated samples of synthetic anonymized data for testing the cloud proof of concepts based on production environment.
  • Optimized long running queries and Etl processes on Teradata and Microstrategy.
  • Supported on the daily production run
  • Configured and maintained pipelines based on Elasticsearch engine on Azure cloud ( log monitoring, cleansing and modeling to the local Datawarehouse)
  • Created dashboards based on the Elasticsearch feeds
  • Converted automatically existing Informatica Power Center mappings in Databricks notebooks by using python and REST API
  • Implemented Data Quality Framework on IDQ
  • Created pipelines for sourcing the local Teradata DWH using REST API 
Teradata Oracle SAP
SwissCom
Bern, Switzerland
7 years
2015-01 - 2021-12

various projects

  • Enriched my business knowledge on Banking by participating on projects like (IFRS9, Securities, Anacredit, CRS, FATCA, BANKENPAKET).


2015 - 2021

  • Supported successfully the continuous integration of regulatory reporting requirements during the period with Quarterly releases


2020 - 2020

  • Implemented following the detailed analysis of the Business needs a new Data quality framework which is able to identify and automatically correct data quality issues coming from the interfaces delivered by local Austrian or CEE subsidiaries This was designed to be Metadata Driven and with custom business checks on Teradata SQL using Stored procedures and python scripts The final results were reported via Power BI.
  • With this framework the need of monthly manual adjustments by Business was decreased by 70% percent and the Quality of the deliveries towards the regulators was improved as well .


2017 - 2017

  • During the Anacredit Project identified and implemented in short time gaps related to ECB requirements by creating an application which was performing comparisons of billions of records between the deliveries towards ECB and the return interface provided by the local Austrian regulator
  • The specific solution was developed by using a combination of SSAS -python and Teradata SQL

Bank Austria(
5 years 7 months
2016-01 - 2021-07

project implementation strategy

Senior Data Engineer
Senior Data Engineer
  • Collected Requirements and provided effort estimation , project implementation strategy as well as Technical solution documentation for 35 Regulatory projects for Bank Austria and Local Subsidiaries.
  • Migrated existing (on premises ) DataMarts to Azure Databricks(redirected source files to Azure Blob storage, Converted existing datastage and SSIS jobs to Databricks notebooks and redefined the scheduling of the jobs by scheduling Databricks notebooks withing Azure datafactory (ADF) pipelines.
  • Converted the existing parquet files in Delta and optimized the storage and performace of the spark notebooks.
  • Acting as Lead Data Engineer and coaching implementation teams on parallel project activities by providing training ,guidance and support on complicated development issues either on Teradata SQL or on Microsoft BI ( SSIS-SSAS-Power BI) or by implementing Data Quality checks( using PL-SQL stored procedures on Oracle -Teradata)
  • Working closely with Business Units (CDO -Regulatory Reporting -Finance and Risk) in analyzing new Regulatory reporting requirements ensuring continuous integration of new features on Production environment.
  • By Using Unicredit internal DEVOPS platform(Gandalf,HPQC,SVN) Analyzed interdependencies between parallel on going projects,defined IT test cases and Production deployment process ensuring "smooth" transition from QA to Prod.
  • Reviewing designs and code developed during full life cycle of each project(DEV-SIT-UAT) and checking quality of results by performing regression tests.
  • Providing post go live support-Production Incidents fixing and collecting - proposing improvements for upcoming projects .
  • Designed Meta data driven SSIS packages by using BIML and MS Visual studio
Unicredit Bank Austria
Vienna, Austria
4 years 10 months
2011-03 - 2015-12

Implemented new requirements on Teradata Financial Model

Lead Data Warehouse Technical Analyst SQL PL SQL
Lead Data Warehouse Technical Analyst
  • Reviewed Functional specifications for new requirements and proposed changes to business analysts.
  • Implemented new requirements on Teradata Financial Model (FSLDM) using SQL ,PL SQL ,IBM DataStage. (starting from parsing data from source systems with structured and unstructured format, staging (Data Stage ), transformations (SQL), calculations (SQL-DAX -MDX) up to delivery of reports to business )
  • Participated on Large scale Migration projects from Oracle to Teradata.
  • Preparing go live and post go live activities and supporting operations team on incident fixing.
  • Providing training to junior developers on Teradata SQL,Performance optimization and Development Guidelines.
  • Performance optimization of approximately 2000 Queries on Teradata by identifying low performing queries (using Explain PLAN ,dbcdbqlog). By this optimization activity and by identifying bottlenecks in the ETL pipeline scheduling nightly batch load was improved by 4 hours
SQL PL SQL
Unicredit Bank Austria
Vienna, Austria
1 year 3 months
2010-01 - 2011-03

Training junior developers

Data Engineer
Data Engineer
  • Supporting Teradata Customers 5 DWH projects across Europe ( Unicredit Italy, Lufthansa, BMW) by fixing complicated issues (like surrogate key definition,performance optimization,data mart design)
  • Training junior developers on SQL and Data Warehousing 
  • Performed large-scale data Migrations to Teradata FSLDM
  • Addressed ad hoc analytics requests and facilitated data acquisitions to support internal projects, special projects and investigations
DWH Consultant Teradata Corp
Prague-Munich-Milan, CZ
6 years
2004-01 - 2009-12

Implemented and Designed Business intelligence Solutions

Microsoft Business Intelligence Engineer SSAS SSRS SSIS
Microsoft Business Intelligence Engineer
  • Implemented and Designed Business intelligence Solutions on 5 Customers (Otis, Carrefour, Rakes LTD,Pinko,Soho-Soho) using Microsoft Business Intelligence Stack (SSAS, SSRS, SSIS)
  • Performed Migrations from old DOS applications to Microsoft ERP and CRM
  • Designed custom solutions in SQL server for Customer Loyalty systems and in connection with Microsoft CRM and ERP
  • Implemented SSIS ETL packages for transferring and loading data from multiple subsidiary databases(retail POS) to Central ERP SQL database
  • Developed SSIS packages for updating automatically POS systems and Electronic Self Labels
  • Barcode design
SSAS SSRS SSIS
various
Athens, Greece
4 years 5 months
2000-01 - 2004-05

migration of data from DOS based application

LogicDIS ERP Developer
LogicDIS ERP Developer
  • Responsible for migration of data from DOS based application to SQL server ERP.
  • Responsible for maintenance of ERP system and for providing support on the central warehouse and the subsidiaries of the company.
  • Infrastructure maintenance( 10 servers ) Developing consolidated reports for warehouse inventory firstly on Seagate crystal Reports and afterwards on Microsoft SQL server.
  • Assisting on designing of Bar codes and pricing system.
  • Collaborated with other developers to identify and alleviate software errors and inefficiencies.
Alouette Clothing Industry
Athens, Greece

Aus- und Weiterbildung

Aus- und Weiterbildung

4 years 1 month
1990-09 - 1994-09

European Economic Studies

Bachelor of Science, Athens University Of Business And Economics - Athens
Bachelor of Science
Athens University Of Business And Economics - Athens

Position

Position

Data Engineer

Kompetenzen

Kompetenzen

Top-Skills

Teradata Databricks IBM SQL PYSPARK PYTHON ETL JIRA REST IBM InfoSphere DataStage SSAS SSIS SSRS POWER BI Informatica PowerCenter BTEQ Banking/Finance Telekommunikation MIGRATION Qualitymanagement Acceptance Test DataDomain

Produkte / Standards / Erfahrungen / Methoden

Profile

An experienced Senior Data Engineer with a strong combination of technical and business analysis skills. Having a well proven record of achievements within challenging environments and specialized for the past 15 years in the Data Warehouse area of Financial Industry. Expertise in delivering on time and on budget with high quality demanding Regulatory -ALM Risk requirements. Experienced in translating the business requirements in high performing technical solutions and leading multi- national software developer teams. Acting as the single point of contact between Business IT Development teams/Operation teams to manage and coordinate the activities required by all key stakeholders in order to deliver the required solution within tight timelines.


Skills

Data Warehousing

  • Teradata
  • MS SQL


Traditional ETL

  • Datastage
  • SSIS
  • Teradata Tools


Cloud ETL

  • Azure Data Factory
  • Databricks
  • Synapse


Data Visualization

  • SSAS
  • SSRS
  • PowerBI
  • Azure Synapse


Data Analysis

  • Finance 
  • Banking
  • Telco


Additional Skills

  • Teradata Utilities 
    • Fast load
    • Fast Export
    • TPT
  • SQL Performance tuning
    • MSSQL
    • TERADATA
    • ORACLE
  • Stored Procedures development
    • SQL 
    • PL-SQL
  • Triggers 
    • SQL 
    • PL-SQL
  • BIML automatic SSIS package generation
  • Tortoise SVN, GIT, GITHUB
  • Unix scripting
  • Microsoft ERP and CRM customization

Programmiersprachen

SQL
PL-SQL
Python
Pandas
REST API


Datenbanken

3NF
Modeling
Data Vault
Modeling



Vertrauen Sie auf GULP

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das GULP Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.