1. Lighthouse

Level 2 · Percentiles for the free-shipping threshold

The request

From Daniel Brooks, Head of Operations

“Orders of $75 or more ship free. Finance wants to raise the threshold to $100. Before we argue, I need to see where our orders actually fall: the quarter points of order value, the top 10% line, and how many orders sit under $75 today.”

Your goal

Set result to a dict with the 25th, 50th, 75th and 90th percentiles of completed["order_value"] under the keys "p25", "p50", "p75", "p90" (each rounded to 2), and "share_under_75": the share of orders with an order value below 75, as a fraction between 0 and 1 rounded to 4.

  • Use the orders DataFramenot done yet
  • Use the order_items DataFramenot done yet
  • Store a dict in resultnot done yet

Your code

Python

Loading the editor…

    ResultPreview of orders · press Run to see yours
    Preview of orders
    order_idcustomer_idorder_datestatuschannel
    10011252023-01-01 20:51:19completedweb
    10021562023-01-02 07:58:46completedweb
    1003222023-01-02 10:25:27completedmarketplace
    1004482023-01-02 11:21:51completedmarketplace

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    What a percentile says

    The p-th percentile is the value that p% of the data falls below. The 25th percentile (P25) of order value is the order a quarter of the way up the sorted list; the 50th is the median; the 90th is where the top 10% begins. In pandas they are all one method:

    v = completed["order_value"]
    v.quantile(0.25)    # 93.99
    v.quantile(0.90)    # 1345.77
    v.quantile([0.25, 0.5, 0.75, 0.9])   # several at once, as a Series

    Statisticians say quantile for the fraction (0.9) and percentile for the percentage (90th). They are the same idea.

    Reading a distribution from four numbers

    On Harbor & Pine’s completed orders: P25 $93.99, median $268.94, P75 $659.87, P90 $1,345.77. The gaps grow as you go up: $175 from P25 to the median, $391 to P75, $686 to P90. Gaps that widen toward the top are the signature of a right-skewed column, the same shape the histogram in level 1 showed. A symmetric column would have roughly equal gaps on both sides of the median.

    Percentiles also survive outliers. A $11,000 order changes the mean; it does not move P25 or P50 at all.

    Shares below a line

    The opposite question, “what share of orders is under $75?”, is answered with a comparison and a mean:

    (v < 75).mean()    # 0.2097, about 21% of orders

    v < 75 gives True or False per order. Python counts True as 1 and False as 0, so the mean is the share of True. This trick works for any condition: (v >= 1000).mean() is the share of orders of $1,000 or more.

    For Daniel’s meeting: one order in five is under the current threshold. Raising it to $100 moves every order between $75 and $100 from “ships free” to “pays shipping”, and you can size that group the same way.

    Common mistakes

    • quantile(25) instead of quantile(0.25). pandas expects a fraction between 0 and 1.
    • Reading P90 as a share of the maximum. P90 is a value from the data, not 90% of the largest order.
    • Mixing up “below” and “at or below”. v < 75 and v <= 75 differ on orders of exactly $75.00. Match the business rule: free shipping applies at $75 or more, so “pays shipping” is v < 75.
    • Counting instead of sharing. (v < 75).sum() is a count of orders. Say which one you report.

    Interview note

    Expect “what is the difference between the median and the 50th percentile?” (none) and “how would you describe this column without a chart?” A five-number summary (minimum, P25, median, P75, maximum) is the classic answer, and describe() prints it for you.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.