Product manager building AI evals, agents & data platforms

I'm Alex Zwir, a customer-obsessed product manager with 20+ years across product and engineering. I own product areas end to end — defining success metrics, prioritizing problems, and adjusting strategy as context changes — while partnering deeply with engineering on system and architecture trade-offs.

Working remotely from São Paulo, Brazil

Contribution Graph

OctNovDecJanFebMarAprMayJunJulAugSep
39 contributions in the last year Less More

Work Experience

Microsoft

Senior Data Product Manager, Outlook

Jul 2021 - Present

Evals platform, AI agents and the telemetry ecosystem for Outlook and Copilot.

Highlights
  • Own the evals platform initiative across Outlook, partnering with 30+ teams inside and outside the org to build and run online and offline evals for AI scenario owners (Summarize, Draft, and others), surfacing quality metrics to hill-climb agent quality toward task-completion and quality targets.
  • Designed and built CEAD (Copilot Evaluation Agent for Data), an AI agent that guides teams end to end — from defining the evaluation objective to generating synthetic data to assembling the complete eval set — feeding Microsoft's internal SEVAL platform, where jobs run daily in production.
  • Use AI-native practices daily to build product artifacts: generating eval sets and synthetic data with AI tools, building DSAT eval sets from real user feedback, and connecting multiple data sources into metrics and dashboards — while embedding responsible AI concepts into the eval harness.
  • Mentor and coach teams on evals as a first-class discipline, leading Outlook's offline-evals office hours to spread an eval-first culture and codify a repeatable playbook that scenario teams reuse.
  • Lead Outlook's telemetry ecosystem — defining success and setting multi-geography data platform strategy, ensuring consistent, reliable, low-latency signals across seven clients at worldwide scale.
  • Led the modernization and unification of High-Value Actions (HVAs), balancing customer experience and engineering constraints and reducing data processing, production, and storage overhead by 86%.
  • Sold new measurement frameworks and standards to 20+ partner teams, driving org-wide adoption of unified telemetry governance and a shared roadmap for Consumer Trust and Copilot metrics.
  • Built internal tools for data discoverability, reliability, and root-cause analysis across 2,000+ telemetry signals, accelerating engineering velocity for client and service teams.

Elo

Senior Product Manager

Aug 2017 - Jun 2021

Digital products for one of Brazil's largest payment networks, from pilot to scaled adoption.

Highlights
  • Owned product engagements end to end — from use-case definition through production launch — coordinating 5+ cross-functional teams (engineering, UX, design, analytics, operations) to deliver multiple digital products from pilot to scaled adoption.
  • Defined success metrics with data and drove decisions from them: customer journey insights translated into product requirements increased returning visitors by 18%, reduced bounce rate by 10%, and consistently exceeded annual engagement and revenue targets by 8%+ (reaching 15% uplift in 2019).
  • Influenced senior stakeholders and business executives, articulating product vision, value propositions, and operational impact to secure alignment and resources for multi-phase rollouts across customer segments and regions in Brazil.
  • Diagnosed adoption friction and iterated to quality targets, using customer behavior insights and product telemetry to identify bottlenecks, resolve friction points, and refine product operations for broader scaling.

Netshoes

Innovation Manager

Aug 2016 - Jul 2017

Marketing Data & Measurement platform for Latin America's largest sports e-commerce.

Highlights
  • Led end-to-end product strategy and execution for the Marketing Data & Measurement platform, partnering with engineering, data science, and CRM teams to build scalable data pipelines, activation workflows, and automated decisioning systems.
  • Built enterprise data infrastructure and connectors — automated first-party data ingestion and synchronization pipelines that improved marketing mix efficiency by 4% and ensured high-quality customer data across Google, paid media platforms, and internal Martech tools.
  • Redesigned identity resolution and audience refresh workflows, cutting reconciliation time from 5 days to 8 hours, with significant gains in targeting accuracy and audience freshness.
  • Delivered automated attribution and performance reporting, increasing the media organization's operational efficiency by 15%+ and enabling near real-time insights for optimization and executive decision-making.
  • Owned the roadmap of the XML price automation engine, a mission-critical service supporting 70%+ of paid media conversions through accurate, real-time product pricing for ads, feeds, and dynamic remarketing.
  • Served as technical lead for cross-channel integrations, overseeing Web Service and API connections between sales, CRM, ecommerce, and marketing systems.

Tboom Interactive

Digital Project Manager

Jul 2015 - Jun 2016

Built and ran the agency's Business Intelligence function for enterprise accounts.

Highlights
  • Worked client-facing with major enterprise accounts (Banco Sofisa, Momentum, Cury, Helbor, MPD), overseeing engineers and analysts and translating each client's business needs into technical solutions and measurable outcomes.
  • Designed data pipelines and analytics workflows on the Google Ads API, Google Analytics, and the Facebook Marketing API, enabling scalable, real-time reporting for key enterprise clients.
  • Led the development of automated media optimization and reporting systems that streamlined campaign management, budget allocation, and performance visibility across paid channels.

Interdotnet

Digital Product Manager

Feb 2010 - Jun 2015

Product discovery and delivery embedded with enterprise clients such as Itaú, TIM, Pernod Ricard and Daycoval.

Highlights
  • Led customer-facing product discovery and delivery on-site with major enterprise clients, refining use cases, optimizing operational performance (SEO, analytics, measurement), and driving adoption of new features and partner connectivity.
  • Owned end-to-end product roadmaps, translating business needs into technical requirements, prototypes, and integration frameworks (APIs, Google Apps Script/JavaScript) for enterprise customers.
  • Aligned cross-functional engineering, business, and partner teams around a unified product vision, leading execution for high-scale integrations and multi-tenant partner workflows across customer segments.

Koza Digital

Senior Software Engineer

Jan 2004 - Jun 2010

Hands-on engineering for web measurement, data collection and internal tooling.

Highlights
  • Architected and implemented web tagging and measurement frameworks for client websites, instrumenting key user actions and business events for accurate data collection, attribution, and downstream activation.
  • Led system and codebase optimization efforts, modernizing legacy internal tools to improve performance, reliability, and long-term maintainability.
  • Applied hands-on engineering across JavaScript, PHP, Python, C#, and SQL to build data collection solutions, automation scripts, and integration services supporting analytics and product insights.

Education

POLI/USP

Master of Software Engineering

Anhembi Morumbi

Bachelor of Business Administration

Skills

Focus AI-powered productsEvalsAI agentsGlobal-scale data systemsTelemetryProduct strategy

Languages English (fluent)Portuguese (native)