loyalty-agent-service/docs/specs/onemarketing/ab_testing.md

title, type, status, domain

title	type	status	domain
A/Bn Testing	OpenSpec	Draft	OneMarketing

A/Bn Testing

Requirement Definition

Evaluates and optimizes marketing elements (content or target customers) to identify better performing campaigns. Supports A/Bn Content testing (same target, different messages) and A/Bn Target Customer testing (same message, different targets).

Process Flow

Pre-Conditions

• Third-party data/results must be available for OLS to collect and analyze.
• Users must have access rights in the "A/Bn Testing" module.

Business Rules

Data Schema (A/Bn Message Content Testing)

Field Name	Description	Logic Type	Constraints / Rules
Campaign ID	Unique identifier.	String (20)	Required. No special characters.
Campaign Description	Description.	String (100)	Optional.
Effective Date From	Start date.	Date	Optional.
Effective End date	End date.	Date	Required.
Message Channel	SMS, Email, Push.	Enum	Required.
Target Customer	OMR Criteria setup for targeting.	Rule	Required.
Variant Content	Multiple variants (A, B, N) defining content based on channel.	Array of Messages	Required. Must be unique within the campaign.
Run Schedule	Schedule parameters.	Complex	Required.

Data Schema (A/Bn Target Customer Testing)

Field Name	Description	Logic Type	Constraints / Rules
Campaign ID	Unique identifier.	String (20)	Required. No special characters.
Campaign Description	Description.	String (100)	Optional.
Effective Date From	Start date.	Date	Optional.
Effective End date	End date.	Date	Required.
Variant Target Customer	Multiple variants (A, B, N) defining OMR Criteria.	Array of Rules	Required. Must be unique within the campaign.
Run Schedule	Schedule parameters.	Complex	Required.

Execution

• ABn batch job triggers effective testing requests based on schedule.
• For content testing, sends variant messages to the same subset of targets. Tracks open rates, click-through rates.
• For target testing, evaluates which criteria setup reaches the most/best customers.

Post-Conditions

• Results are reported back to the user to make data-driven decisions on campaign rollout.