Azure SQL Data Engineer

Posted 31 May 2024
Salary £550.00 - £600 per day
Job type Freelance
Discipline Social, Content & Influencer Marketing
Contact NameMalik Osman

Job description

Job Description: Data Engineer - Mission Critical


We are seeking a highly skilled Data Engineer with a strong DBA background, solid .Net and C# development experience, and proficiency in Entity Framework to join our mission-critical team at my client's company. This role involves working on a significant project aimed at revitalizing a legacy SQL Server database and migrating it to Azure SQL. The successful candidate will play a crucial role in ensuring the performance, reliability, and scalability of our data infrastructure.

Key Responsibilities

  • Database Revitalisation
    • Fix and optimize the legacy SQL Server database.
    • Address performance issues, broken elements, and gaps, particularly those stemming from Entity Framework's code-first approach.
  • Migration Planning and Execution
    • Plan and execute the migration of the SQL Server database to Azure SQL within the first three months.
    • Aim for a data-tier application for better maintainability and scheduled job engineering solutions.
  • Performance Tuning
    • Enhance database performance and ensure efficient data querying and management.
    • Optimize SQL connection usage and data model management.
  • SQL Server Agent Jobs
    • Manage and optimize SQL Server Agent jobs, ensuring they run efficiently and without errors.
  • Testing and Validation
    • Conduct backend testing to ensure the robustness of the database and its readiness for migration.
    • Set up integration environments and run Benchmark.NET tests.
  • Data Integrity
    • Ensure data integrity and consistency during the transition from the legacy system to Azure.
  • Collaboration
    • Work closely with other team members and stakeholders to align platform services and meet project goals.
    • Profile both service and database performance, identifying hotspots in both the application and database.
  • Key Qualifications
  • Experience with SQL Server
    • Proven experience with performance tuning and managing SQL Server Agent jobs.
    • Ability to optimize slow SQL queries using tools like New Relic.
  • Azure SQL Expertise
    • Hands-on experience with Azure SQL, with a strong understanding of its features and migration processes.
  • .Net and C# Development
    • Solid experience in .Net and C# development.
    • Proficiency in Entity Framework, with a focus on optimizing code-first approaches.
  • Problem-Solving Skills
    • Ability to identify and resolve issues within legacy databases and ensure smooth migration to new platforms.
  • Data Performance Optimization
  • Deep understanding of data performance and optimization techniques.
    • Capability of setting up integration environments and running Benchmark.NET tests.
  • Project Management
    • Ability to manage and execute a project within specified timelines, particularly under mission-critical conditions.
  • Government Data Experience
    • Experience working with government data, particularly with HMRC, is a plus.
  • Attention to Detail
    • Keen attention to detail and commitment to data accuracy and integrity.
  • Communication Skills
    • Excellent communication skills to articulate issues, solutions, and progress to stakeholders.

Ideal Candidate

  • Capable of setting up integration environments.
  • Running Benchmark.NET tests.
  • Profiling both service and database performance.
  • Identifying hotspots in both application and database.
  • Not just focusing on database profiling but also the C# end.
  • Able to transition the system to a Platform as a Service (PaaS) database for better maintainability.
  • Develops engineering solutions that allow general C# developers to maintain the system without ongoing data engineer intervention.

Additional Information

  • Location Requirement: The position requires working on-site at least one day a week
  • Project Duration: The initial contract is for 3 months, with the potential to extend based on project needs and performance.
  • Urgency: This position is mission-critical with an expected start date as soon as possible. Applications will be reviewed on a rolling basis until the role is filled.