Open role, Web, Apps & Experience
CRO & Experimentation
Specialist
Growth from the traffic a client already pays for. Research, hypotheses, experiments, and the honesty to call a flat test flat.
Research, hypotheses and experiments that settle an argument
Wise Pirates seeks restless people, focused on evolving to learn, on producing meaningful impacts, and on working in a highly collaborative way, in a Digital and Tech context. We want to meet people who are digital natives and full of good energy and a good attitude.
CRO is where opinions go to be tested. The job is to find where a funnel loses people, form a hypothesis about why, and design an experiment that can actually answer it. Most of the value is in the research and the prioritisation; the test is just how you find out whether you were right.
It is also a seat that requires a certain stubbornness about evidence. Roughly two thirds of tests do not win, and a specialist who reports otherwise is either lucky or rounding. You will need to be comfortable telling a client that their favourite idea did nothing, and to have the numbers ready when you do. Like everyone here, you will be judged on the marginal value you add to the company and to the projects you touch.
What you will actually do
- Conversion ResearchFind the friction: funnel and drop-off analysis, heatmaps, session replay, form analytics, plus the qualitative side through surveys and user feedback.
- HypothesesTurn findings into hypotheses that state what you expect to change and why, rather than a list of improvements.
- PrioritisationRank a backlog with ICE, PIE or whatever the client can actually live with, and defend the order. Our own framework, PIRATE, gives the sequence a shape, and you will learn it here rather than arrive knowing it.
- Test DesignDesign A/B, A/B/n, multivariate and split-URL tests with the sample size, duration and success metric agreed before the test starts.
- ImplementationBuild or brief the variants, and validate that the test is running as designed before trusting a single number.
- AnalysisRead results with statistical care: significance, power, segment effects, and the discipline not to stop a test because it looks good on day three.
- Full-Funnel WorkTake the work beyond the landing page, from ad to page to checkout to the CRM behind it.
- Programme BuildingHelp a client build a testing habit: cadence, documentation, a shared record of what has been tried and what it taught us.
- ReportingReport in business terms, revenue and conversion rate, and be equally clear about the tests that lost.
Technical & platform skills
- Experience
- 2 to 4 years in CRO, experimentation, growth or digital analytics with hands-on testing behind you.
- Statistical literacy
- A working understanding of sample size, significance, power and the traps: peeking, multiple comparisons, novelty effects.
- Analytics
- Comfort in Google Analytics 4 and with the behavioural tooling that shows what a page actually does: heatmaps, session replay, funnel reports.
- Testing practice
- Experience running A/B tests end to end in some tool, whatever it was.
- Web fundamentals
- Enough HTML, CSS and JavaScript to read a variant, brief one properly, and spot when a test is broken.
- Commercial reasoning
- Ability to connect a conversion rate to revenue, margin and what the client is actually trying to grow.
- AI literacy
- Literacy in Tech and AI subjects, and sophisticated use of AI platforms in the research and testing loop, both with efficiency and security: synthesising sessions, surveys and feedback, and generating variants, without letting the tool manufacture a pattern that is not in the data.
- Languages
- Fluent Portuguese and solid English.
Behavioral skills
- Kindness
- At Wise Pirates we promote and admire kindness, independently of rhythm, intensity and efficiency.
- Curiosity
- You want to understand why something behaves the way it does, and you keep asking after the first answer.
- Ownership
- Accountability for what you deliver and for what you promise a client.
- Collaborative Spirit
- Proactive in working across multi-disciplinary teams, sharing knowledge rather than holding it.
- Analytical Mindset
- Capable of putting data first and obsessed with insight building, always with client satisfaction and business results in mind.
- AI Readiness
- Interest and fluency in using AI as a partner to deliver efficient value, respecting security and privacy regulations.
- Results-Oriented Zeal
- An unwavering commitment to the client’s bottom line, pushing boundaries to chase the best overall performance and business goals.
Not required. Noticed.
- Additional years of experience beyond the range above, for a broader remit and more ownership over how the discipline is run.
- Hands-on with a dedicated experimentation platform, client-side or server-side.
- Server-side or edge testing, and the flicker problem it solves.
- Bandit or adaptive testing, and knowing when it beats a fixed-horizon test.
- E-commerce experience: catalogue, checkout, payment and post-purchase.
- Lead generation funnels, forms and lead quality as an outcome rather than volume.
- Personalisation or segment-level targeting.
- UX research or usability testing in your own hands.
- Copywriting for tests, or working closely with someone who does it.
- Tag management and building your own tracking for a test.
- Using generative AI to synthesise session data or generate variants.
- Experience with incrementality testing or geo experiments.
A Digital, Tech and AI Business Partner
Wise Pirates is a leading Digital, Tech, and AI Business Partner, operating from Portugal. With a team of 100+ professionals, we are a Martech-independent agency at the forefront of innovation in Southern Europe. Our ambition is to lead an AI-first marketing ecosystem, blending human creativity with the power of artificial intelligence.
We are dynamic, forward-thinking, and driven by data, automation, and meaningful customer experiences. We believe that our people are our most valuable asset, and we are committed to fostering a culture where they can grow, innovate, and thrive.
Our value proposition is holistic and new generation. We combine services with proprietary products, custom data and proprietary frameworks, so the client gets one capability aimed at their business results, not a stack of separate disciplines. You get to work across all of it.
The part most
job ads skip
- A front-row seat in a growing agency placing AI at the centre of how we work and how we serve our clients, both in service and products. Senior peers in every discipline, our sharpest edge and your fastest growth.
- A culture of autonomy connected to a clear orientation towards action and performance. You own your projects end-to-end and have real space to grow. The rhythm is intense and evolution happens at a fast pace.
- Direct exposure to a wide range of use cases, industries, and clients across 80+ countries, with real impact on what gets shipped.
- Continuous learning alongside a cross-functional team of automation, data, media, and creative specialists.
Why join the navy when you can be a pirate?
Portugal, hybrid, full time. Direct client impact from day one, alongside senior peers in every discipline.
Apply for this role
