AOne Digital Commerce Platform

Product Information Management ยท Data Pipeline ยท Shopify Ecommerce โ€” AWS us-east-1

Platform Overview
One source of truth for a multi-store grocery chain
AOne Supermarkets runs multiple retail locations across Barbados, each historically managing its own product catalogue. This platform centralises product, order, customer, and loyalty data into a single AWS-hosted system โ€” with Shopify as the live customer-facing ecommerce front-end and {n}.bora providing the real-time sync bridge between the PIM and the online store.
25
AWS Glue ETL jobs across all data domains
5
RDS MySQL environments (prod, test, dev, store)
805
Shopify orders fulfilled online
BBD 264
Average order value
2.09%
Shopify store conversion rate
~RT
PIM-to-Shopify sync via {n}.bora custom app
System Architecture

Data Flow โ€” In-store sources to customer-facing Shopify

Sources
๐Ÿช
In-store POS
EMERALD, C + other store codes
In-Store Point-of-SaleRetail tills across all AOne locations feed sales, inventory, and product data into the AoneRDS MySQL database (store management system).
๐Ÿ“ฆ
Supplier Feeds
CSV, EDI, manual uploads
Supplier DataProduct master data, pricing, and inventory updates from suppliers. Uploaded via the PIM admin interface (Amplify/Lambda) or batch CSV import.
๐Ÿ‘ฅ
Customer CSV Exports
Loyalty + profile data
Customer DataCustomer profiles and loyalty points exported from in-store systems as CSV files, then ingested via Glue into the data lake and DynamoDB.
โ†“         โ†“         โ†“
Store DB
๐Ÿ—„๏ธ
AoneRDS (MySQL)
db.t3.small ยท us-east-1 ยท Store management system
AoneRDSThe primary store management database. Holds in-store product data, SKUs, pricing, inventory levels per location. This is the authoritative in-store source that the PIM reads from and reconciles against.
๐Ÿ“‹
Orders RDS
Online order records
Orders in RDSShopify orders and online transactions are written back into RDS for reporting and reconciliation against in-store systems.
โ†“                  โ†“
ETL Pipeline
โš™๏ธ
AWS Glue โ€” 25 ETL Jobs
Products ยท Orders ยท Customers ยท Loyalty ยท Fraud ยท Shopify Sync
AWS Glue ETL Layer25 jobs covering the full data platform: daily PIM pipeline, near-real-time Shopify sync, orders to DynamoDB, customer CSV ingestion, loyalty parquet conversion, fraud indicator downloads, and bulk backfill jobs for new product populations.
โ†“        โ†“        โ†“
Storage
๐Ÿ—ƒ๏ธ
PIM RDS (PROD)
product-information-management-prod
PIM Production DatabaseThe canonical product catalogue. All enriched product data, metadata, descriptions, categories, images, and cross-store attributes live here. 4 environments: prod, test, dev (product-information-management, product-information-management-2).
๐Ÿชฃ
S3 Data Lake
aone-products-datalake
S3 Data LakeStores intermediate and archival data. Key paths: instore-metadata/ (raw store metadata), product-detail/ (enriched product records), product-update-uploader/products-detail-update/ (staged updates), customer archives, loyalty parquet files.
โšก
DynamoDB
Orders + Customer lookups
DynamoDBHigh-performance NoSQL layer for online orders and customer profile lookups. Orders are moved from RDS to S3 then into DynamoDB via dedicated Glue jobs (aone-orders-rds-to-s3, aone-orders-s3-ddb).
โ†“         โ†“             
Sync Layer
๐Ÿ”„
{n}.bora Shopify App
Bidirectional ยท Near real-time ยท Custom Shopify integration
{n}.bora Custom AppBespoke Shopify app built by the {n}.bora team. Bridges PIM and Shopify bidirectionally โ€” product updates in PIM push to Shopify within minutes; Shopify order events flow back into reporting. Key contacts: Guy Meakin and Peter (see Accounts tab).
๐Ÿ–ฅ๏ธ
Admin UI
AWS Amplify + Lambda
PIM Admin InterfaceWeb-based admin built on AWS Amplify with Lambda functions backend. Used by the AOne team to manage product data, trigger updates, and monitor sync status. Keeper credentials stored under AOne project.
โ†“             
Customer-Facing
๐Ÿ›’
Shopify Online Store โ€” aonesupermarkets
admin.shopify.com/store/aonesupermarkets ยท Online Store + Point of Sale + Google & YouTube
Shopify StoreThe live customer-facing online supermarket. Powered by product data from the PIM via {n}.bora and Glue sync jobs. Sales channels: Online Store, Point of Sale (in-store Shopify), Google & YouTube. Installed apps include Matrixify (bulk import/export) and the {n}.bora custom PIM connector.

Shopify Store โ€” Live Metrics

admin.shopify.com/store/aonesupermarkets ยท Barbados

805
Total orders fulfilled
12.8K
Total sessions
BBD 264
Avg order value
2.09%
Conversion rate
3
Sales channels active
~RT
PIM sync cadence
Data Domains
What the platform manages
This is more than a PIM โ€” it is the full data backbone for AOne's digital operations.
๐Ÿ“ฆ
Product Catalogue (PIM/MDM)
Centralised product records including names, descriptions, barcodes, prices, images, sub-departments, and store-specific attributes. Source of truth for both in-store and online inventory.
๐Ÿ›’
Shopify Product Sync
Near real-time and daily batch sync of products from PIM to Shopify. Multiple Glue jobs handle different sync patterns: daily ETL, bulk backfill, individual updates, and create-new-product flows.
๐Ÿ“‹
Orders Pipeline
Online orders flow from Shopify into RDS, then via dedicated Glue jobs into S3 and DynamoDB for fast lookup and reporting. Includes Shopify fraud indicator download jobs.
๐Ÿ‘ฅ
Customer Data
Customer profiles ingested from CSV exports, archived to S3, and loaded into DynamoDB. Enables unified customer view across in-store and online channels.
โญ
Loyalty Points
In-store loyalty point data processed via dedicated Glue job (aone_point_to_parquet) and stored in columnar format for efficient analytics queries.
๐Ÿ›ก๏ธ
Fraud Indicators
Shopify fraud indicator data downloaded and processed via dedicated job, feeding into order risk assessment and reporting.
๐Ÿช
Multi-Store Inventory
Per-location inventory data from AoneRDS (store codes EMERALD, C, and others). Glue jobs reconcile in-store stock levels against the online catalogue.
๐Ÿ–ฅ๏ธ
PIM Admin Interface
AWS Amplify-hosted web UI backed by Lambda functions. Enables product managers to update the catalogue, trigger sync operations, and monitor pipeline status without direct database access.
Contacts
Who to call
Guy Meakin
{n}.bora โ€” Shopify Integration Lead
Peter
{n}.bora โ€” Backend / PIM Sync Developer
Verso Labs
AWS infrastructure, pipeline architecture, project management
๐Ÿ”’

Internal View โ€” Access Required

This section contains pipeline architecture details, known issues, and technical runbooks.

Incorrect code โ€” try again
๐Ÿ”’

Internal View โ€” Access Required

This section contains credentials references, environment config, and AWS account details.

Incorrect code โ€” try again