Power of RFM Analysis for Customer-Lifetime-Value (CLTV) & Market Basket Analysis for cross-selling, recommendations, promotions or even placement of items on a menu or in a store to increase customer retention

Kuo Sheng Ang
6 min readAug 13, 2021

--

RFM is a dynamic customer scoring methodology for assigning each customer a value based on historical purchase data. When required to determine customer lifetime value, RFM enables firms or brands to understand customers’ activities at a more granular, segmented level. In turn, the messaging and promotions can be tailored to the determined value in the RFM scoring methodology. In practice, we can bucket the segments into a value spectrum profiles based on variations of customer personas: VIP, Regular, and New Customer, Lost Customer, Big Spender which usually have to be aligned with the marketing programme. The gradations of customer type allow me to personalize content and messaging by bucket in a way that more closely aligns with the customer’s behavior.

Example of RFM Framwork for Customer Lifetime Value

Customer lifetime value insights at this level make it exponentially easier to quickly spot positive or negative movement along the RFM spectrum to strengthen relationships and mitigate churn.

With the RFM scoring which enhances visibility into customer’s behavioral data, it can provide insights make actionable decision to segment the customer base and apply for different marketing programs for different groups or clusters.

To achieve this RFM Scoring analysis without much investment in cost of software licensing, it can be realized using software applications such as Tableau Desktop or Python which can be complemented with Bokeh libraries to achieve the interactivity for data exploration to be on par with Tableau. Public Tableau domain is free.

**Below is an illustration how RFM Scoring can be achieved using Transactional DataSet of a Canadian MegaStore for demonstration.

(Disclaimer: data values are not actual for confidentiality purpose)

Dataset Attributes or Features

1.1 Time series of the number of transactions (daily)

  • Time series of the number of transactions (daily) between the stipulated time-frame (ie: from 2009 to 2013)

1.2 Sales Transaction Volume of each province and region in Canada

1.3 Typical inter-purchase time and IPT distribution (in histogram) & details for each customer

  • To aid any firm in understanding their customer’s purchasing behaviour and profile, below are the few examples showing how Python programming can achieve presenting customer’s Number of Purchase(s) between Periods and Distribution of Customer(s)’s Purchase in histogram which cannot be realized using Excel standard features. It can be achieved using Excel VBA macro or VB.Net. the recent improvement in Tableau integration with Tableau Prep and TabPy Server enables Python script to be embedded for customized analysis according to business requirement to leverage on Tableau interactivity features.

Distribution of IPT (Inter-purchase Time) in histogram:

  • Below is an illustration on distribution of the number of purchases per customer :
  • histogram of the customer’s visits/patronization frequency to store, using the python lifetimes package & libraries
  • Using the python lifetimes package — plot_frequency_recency_matrix library allows us to visualize the store frequency recency matrix of this megastore’s business
  • Distribution Plot on Probability of Customer alive (ie:active) & tabular form details of each customer.

From this frequency and recency plot, with the probability showing that significant number of customers for this store has small distribution to be alive (ie: active)

  • Below is an illustration of me utilizing Tableau for RFM Analysis, with customer scoring assigned for each customer based on their historical purchase data

https://public.tableau.com/authoring/Sales_Trend_16277222014070/RFMScoring_1/RFM%20Dashboard#1

  • Profiling customer(s) into the various personas group which has to be aligned with their CRM (Customer Relationship Management) strategy to tailor marketing messaging and promotions, marketing campaign or promotions for the respective customer personas: VIP, Regular, and New Customer. The gradations of customer type enables any firm to personalize content and messaging in a way that to strengthen & boost customer’s purchasing engagement as part of their CRM (Customer Relationship Management) strategy.
  • After classifying or assigning all the customers into segments with their RFM profiles as shown above, we can then aggregate the population size of each RFM profile segment which i have tabulated using a simple bar chart. Another form of visualization is done using Treemap to illustrate the different RFM segments expressed in percentage (%).
  • To ensure achieving success in reducing customer churn or rate of attrition, LIFT analysis can be used to measure the impact of any firm’s marketing or promotional campaigns so that they can continue to make variation marketing strategies to improve their customer’s engagement as part of their CRM programme. Market Basket Analysis is also an avenue to identify what assortment of products most frequently occur together in orders. Using this relationship to increase profitability through cross-selling, recommendations, promotions, or even the placement of items on a menu or in a store to increase customer retention.

1.4 Association Mining as part of Market Basket Analysis

  • Association mining using FPGrowth algorithm or Apriori algorithm

One of most common approach to find patterns other than clustering is Market Basket Analysis, which is a key technique used by large retailers like Amazon, Flipkart, etc to analyze customer buying habits by finding associations between the different items that customers place in their “shopping baskets”. The discovery of these associations can help virtually any firms with diverse assortment of products to develop marketing strategies is by gaining insight into which items are frequently purchased together by customers. The strategies may include:

  • Changing the store layout on assortment according to customer’s pyschological shopping behaviour that appeals and attracts their attention
  • Customer behavior analysis
  • Cross marketing or Cross-selling as part of the recommender system
  • Purchase with purchase (PWP) promotional campaign

--

--

No responses yet