Posted

Senior Data Analyst - Experimentation & A/B Testing (f/m/d)

by adjoe

  • Advertising Technology
  • Mobile Marketing
  • AdTech
Hamburg, Germany
Hybrid
Full-time
Professional or Experienced
I’m interested

Free account · stay hidden from your current employer

Your interest is shared with employers only as an anonymized demand signal.

Introduction

adjoe builds the technologies behind mobile apps growth and monetization. With our core product **Playtime Arcade**, we've become the global leader in rewarded advertising, an ad unit built on a simple premise: users earn real in-app rewards for engaging with new apps. The result is one of the most effective value exchanges in adtech, connecting advertisers and publishers with over 770 million users annually.

**Investigating 770 Million User Interactions Across a 100TB Data Lake**

When a platform serves **770 million users**, every optimization from reward mechanics to SDK integrations needs to be grounded in data. The Rewarded Analytics team builds the internal dashboards, alerting systems, and data pipelines that monitor the user funnel, traffic engagement, and reward consistency.

Tasks

  • Build internal dashboards, alerting systems, and data pipelines that monitor the user funnel, traffic engagement, and reward consistency
  • Conduct deep-dive investigations using SQL and Python on 100 terabyte-sized data analyses queried through Trino
  • Create real-time insights on product performance using Tableau as the main visualization tool
  • Provide data that turns questions into answers: every A/B experiment the product team runs, every anomaly a publisher flags, and every new SDK integration
  • Design experiments and calculate sample sizes
  • Manage variance reduction techniques and analyze A/B/n tests to ensure statistically sound business decisions
  • Work with anomaly detection algorithms and approaches like distribution analysis and cross-population comparison to monitor test guardrail metrics and identify unexpected shifts in experiment data
  • Understand the end-to-end telemetry and feature flagging systems that power experimentation
  • Build automated experiment reporting dashboards, reusable analytical frameworks, and data visibility solutions
  • Work closely with product managers, engineers, and growth leads to translate complex statistical results into clear, actionable recommendations that drive executive decision-making

Requirements

  • 5+ years as a Data Analyst
  • Work fluently in both SQL and Python, writing complex queries, big data optimizations, and analysis pipelines to support product and growth initiatives
  • Deep experience designing experiments, calculating sample sizes, managing variance reduction techniques, and analyzing A/B/n tests to ensure statistically sound business decisions
  • Ability to reason confidently about core statistical concepts—hypothesis testing, confidence intervals, p-values, power analysis, and Bayesian vs. Frequentist approaches—and apply them to real-world product decisions
  • Experience working with anomaly detection algorithms and approaches like distribution analysis and cross-population comparison to monitor test guardrail metrics and identify unexpected shifts in experiment data
  • Understanding of the end-to-end telemetry and feature flagging systems that power experimentation
  • Experience with dbt, Airflow, or experiment platforms (e.g., Optimizely, GrowthBook) is a strong plus

Benefits

  • Go Big. Own projects with impact on 770M users and push adtech boundaries.
  • Move Fast. Ship solutions multiple times a day, learn from results, and keep momentum.
  • Be Direct. Solve problems openly and collaborate across teams.
  • Thrive Together. Grow with a diverse, global team of people from over 40 different countries that learn from each other.
  • Have Fun. Celebrate wins, enjoy daily victories, and bring your energy.
adjoe

adjoeHamburg, Germany

Industries
Advertising Technology, Mobile Marketing, AdTech
Company size
201-500
Growth
41%