1. Lighthouse

Level 4 · Shipping and merchandise revenue per channel

The request

From Brian Mitchell, Finance Analyst

“My revenue split by channel doesn't match the ledger: shipping looks way too high, and marketplace is more than double what the ledger says. Can you give me shipping fees and merchandise revenue per channel for completed orders, done properly?”

Your goal

For orders with status 'completed', return one row per channel with: channel, orders (number of orders), shipping_revenue (sum of shipping_fee, each order counted once, rounded to 2) and merchandise_revenue (sum of net line revenue quantity * unit_price * (1 - discount_pct / 100.0) over lines with quantity > 0, rounded to 2).

  • Read from the orders tablenot done yet
  • Read from the order_items tablenot done yet
  • Show exactly channel orders shipping_revenue merchandise_revenuenot done yet

Your query

SQL

Loading the editor…

    ResultPreview of orders · press Run to see yours
    Preview of orders
    order_idcustomer_idorder_datestatuschannel
    10011252023-01-01 20:51:19completedweb
    10021562023-01-02 07:58:46completedweb
    1003222023-01-02 10:25:27completedmarketplace
    1004482023-01-02 11:21:51completedmarketplace

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    Tables

    Harbor & Pine store data, ready to query.

    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NULL
    10021562023-01-02 07:58:46completedweb0.00NULL
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNULL
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNULL
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNULL
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NULL2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNULL2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NULL2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NULL2023-01-01 16:55:46desktopdirect7false
    4NULL2023-01-01 12:43:28mobileorganic3false
    5NULL2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    Brian’s query is a textbook case of the fan-out from chapter 5. shipping_fee lives on orders, one value per order. After joining to order_items, each order’s fee is copied onto every line, and SUM(o.shipping_fee) adds it once per line. Run the starter: shipping comes out about 1.5 times too high on web and app and about 2.4 times too high on marketplace, where fee-paying orders tend to have more lines. The inflation is not even a constant factor you could divide away. Merchandise revenue is fine, because it is a line-level number summed at line level.

    The fix: aggregate the many side first

    Bring order_items down to the grain of orders (one row per order) before joining:

    WITH line_totals AS (
      SELECT order_id,
             SUM(quantity * unit_price * (1 - discount_pct / 100.0)) AS merchandise
      FROM order_items
      WHERE quantity > 0
      GROUP BY order_id
    )
    SELECT o.channel,
           COUNT(*) AS orders,
           ROUND(SUM(o.shipping_fee), 2) AS shipping_revenue,
           ROUND(SUM(COALESCE(l.merchandise, 0)), 2) AS merchandise_revenue
    FROM orders AS o
    LEFT JOIN line_totals AS l ON l.order_id = o.order_id
    WHERE o.status = 'completed'
    GROUP BY o.channel;

    Now each order matches at most one line_totals row. The join cannot multiply anything, so both sums are correct and COUNT(*) counts orders again.

    Why LEFT JOIN and COALESCE

    An order whose lines were all filtered out (for example, only bad quantities) has no line_totals row. An inner join would drop that order and its shipping fee. The LEFT JOIN keeps it, and COALESCE(l.merchandise, 0) treats its missing merchandise as zero. Here zero is a true default: the order had no valid merchandise, so this is the legitimate use of COALESCE from chapter 6, not hiding an unknown.

    The general recipe

    When you need measures from two tables at different grains:

    1. Decide the output grain (here: channel).
    2. Aggregate each “many” table up to the join key (here: per order) in its own CTE.
    3. Join the CTEs one-to-one, then aggregate to the output grain.

    With two child tables, for example lines and returns per order, the recipe matters even more. Joining both raw tables to orders multiplies lines by returns, and every number is wrong. Pre-aggregate each one separately, then join.

    Reconcile

    The finance check is simple: SELECT SUM(shipping_fee) FROM orders WHERE status = 'completed' must equal the sum of shipping_revenue across channels. If it does, the fan-out is gone. Build this kind of cross-check into your routine for any number that goes to finance.

    Interview note

    This pattern, “aggregate before you join”, is one of the clearest signals of experience in an analyst interview. If you are asked to combine orders, items and payments or sessions, say up front which grain each table has and how you will avoid double counting. It often matters more than the final syntax.