1. Lighthouse

Level 1 · Order value bands

The request

From Jordan Reyes, Head of Marketing

“I'm planning offers by basket size: one for small baskets, one for mid-size, one for big spenders. Before I pick the cut-offs, how are our orders spread across price bands?”

Your goal

Cut completed["order_value"] into the bands given in the starter with pd.cut(..., bins=bins, labels=labels). Set result to the share of orders in each band, as returned by .value_counts(sort=False, normalize=True), rounded to 3 decimals (a Series indexed by band, bands in order).

  • Use the orders DataFramenot done yet
  • Use the order_items DataFramenot done yet
  • Show exactly order_value proportionnot done yet
Share of orders and share of revenue by order value band
Share of orders and share of revenue by order value band0%10%20%30%40%under $100, Orders: 26.2%under $100, Revenue: 2.3%under $100$100-250, Orders: 21.8%$100-250, Revenue: 6.9%$250-500, Orders: 19.8%$250-500, Revenue: 13.2%$250-500$500-1,000, Orders: 16.7%$500-1,000, Revenue: 21.8%$1,000-2,500, Orders: 12.4%$1,000-2,500, Revenue: 34.5%$1,000-2,500$2,500+, Orders: 3%$2,500+, Revenue: 21.3%Order value bandOrdersRevenue
Share of orders and share of revenue by order value band0%10%20%30%40%under $100, Orders: 26.2%under $100, Revenue: 2.3%under $100$100-250, Orders: 21.8%$100-250, Revenue: 6.9%$250-500, Orders: 19.8%$250-500, Revenue: 13.2%$500-1,000, Orders: 16.7%$500-1,000, Revenue: 21.8%$500-1,000$1,000-2,500, Orders: 12.4%$1,000-2,500, Revenue: 34.5%$2,500+, Orders: 3%$2,500+, Revenue: 21.3%Order value bandOrdersRevenue

Small baskets are a quarter of all orders and 2% of revenue. Orders above $1,000 are 15% of orders and more than half of revenue.

Show the numbers
Order value bandOrdersRevenue
under $10026.2%2.3%
$100-25021.8%6.9%
$250-50019.8%13.2%
$500-1,00016.7%21.8%
$1,000-2,50012.4%34.5%
$2,500+3%21.3%

Your code

Python

Loading the editor…

    ResultPreview of orders · press Run to see yours
    Preview of orders
    order_idcustomer_idorder_datestatuschannel
    10011252023-01-01 20:51:19completedweb
    10021562023-01-02 07:58:46completedweb
    1003222023-01-02 10:25:27completedmarketplace
    1004482023-01-02 11:21:51completedmarketplace

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    Shape before summary

    Last chapter you saw that the mean order ($543) is twice the median ($269). That gap tells you the column is right-skewed, but not what the shape looks like. A distribution answers “how many values are there at each size?”, and to see it you group the values into ranges, called bins or bands, and count each one.

    pandas measures the lopsidedness directly:

    completed["order_value"].skew()   # 3.95

    A skew of 0 means symmetric. Above 1 is strongly right-skewed: most values are small, with a long tail of big ones. Order values sit at almost 4.

    Cutting values into bands

    pd.cut assigns each value to a band you define:

    bins = [0, 100, 250, 500, 1000, 2500, float("inf")]
    labels = ["under $100", "$100-250", "$250-500", "$500-1,000", "$1,000-2,500", "$2,500+"]
    bands = pd.cut(completed["order_value"], bins=bins, labels=labels)
    bands.value_counts(sort=False)

    Each band includes its right edge: an order of exactly $100.00 lands in “under $100”. A value outside every band (here the 4 orders worth $0 or less) gets NaN and is left out of the counts. sort=False keeps the bands in their natural order instead of sorting by count.

    Uneven bands on purpose

    The bands here get wider as values grow: $100, $150, $250, $500, $1,500 wide. On a skewed column that is the point. Equal $500 bands would put two thirds of orders in the first band and leave the top bands with a handful each. Wider bands where the data is thin keep every band meaningful.

    Orders versus revenue

    The chart puts two distributions side by side. Orders pile up on the left: a quarter of them are under $100. Revenue piles up on the right: those small baskets bring in 2% of sales, while orders above $1,000 (15% of orders) bring in more than half. Both are true, and they answer different questions. “Where are most customers?” is the orders view. “Where is the money?” is the revenue view. A good analyst shows Jordan both before he sets offer thresholds.

    Common mistakes

    • Forgetting the edges. pd.cut includes the right edge and excludes the left. A first edge of 0 drops zero and negative values; check how many NaN you get with bands.isna().sum().
    • Sorting by count. value_counts() sorts the biggest band first by default. On order values the bands happen to shrink in order, so you wouldn’t notice; on most columns it scrambles the distribution. Say sort=False and the bands stay in their own order.
    • Equal-width bands on skewed data. Most bands end up nearly empty and one band holds most of the data. Use bands that match how the business talks, or quantiles with pd.qcut.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.