1. Lighthouse

Level 6 · Boss: performance snapshot

The request

From Megan Collins, Head of Sales

“The leadership offsite needs three numbers tables: our top-selling products by revenue, what returns are costing us by reason, and how well each traffic source converts.”

Your goal

Step 1 of 3. From order_items, considering only rows with quantity > 0 (all order statuses), return the top 10 products by net revenue with columns product_id, units (sum of quantity) and net_revenue (sum of quantity * unit_price * (1 - discount_pct / 100.0), rounded to 2). Sort by net_revenue descending, then product_id ascending.

  • Read from the order_items tablenot done yet
  • Show exactly product_id units net_revenuenot done yet
  • 10 rows, sorted as askednot done yet

Step 1 · your query

SQL

Loading the editor…

    ResultPreview of order_items · press Run to see yours
    Preview of order_items
    order_item_idorder_idproduct_idquantityunit_price
    11001121931.99
    21001154311.99
    31002154411.99
    410021941149.00

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    Step 2 · your query

    SQL

    Loading the editor…

      ResultPreview of returns · press Run to see yours
      Preview of returns
      return_idorder_item_idreturned_onreasonrefund_amount
      1142023-01-10damaged83.69
      2422023-01-10wrong_item19.99
      31052023-01-14wrong_item10.99
      4242023-01-16changed_mind26.99

      Mote checks your result

      Press Run. Each row that matches the goal becomes a firefly in your lantern.

      Step 3 · your query

      SQL

      Loading the editor…

        ResultPreview of web_sessions · press Run to see yours
        Preview of web_sessions
        session_idcustomer_idstarted_atdevicesource
        1NULL2023-01-01 23:02:24mobilepaid
        2182023-01-01 15:07:49desktoppaid
        3NULL2023-01-01 16:55:46desktopdirect
        4NULL2023-01-01 12:43:28mobileorganic

        Mote checks your result

        Press Run. Each row that matches the goal becomes a firefly in your lantern.

        Tables

        Harbor & Pine store data, ready to query.

        order_items30,338 rows · 6 columns
        • order_item_idinteger
        • order_idinteger
        • product_idinteger
        • quantityinteger
        • unit_pricedecimal
        • discount_pctdecimal
        First 5 rows of order_items
        order_item_idorder_idproduct_idquantityunit_pricediscount_pct
        11001121931.990.00
        21001154311.990.00
        31002154411.990.00
        410021941149.000.00
        51002193219.990.00
        returns1,673 rows · 5 columns
        • return_idinteger
        • order_item_idinteger
        • returned_ondate
        • reasonvarchar
        • refund_amountdecimal
        First 5 rows of returns
        return_idorder_item_idreturned_onreasonrefund_amount
        1142023-01-10damaged83.69
        2422023-01-10wrong_item19.99
        31052023-01-14wrong_item10.99
        4242023-01-16changed_mind26.99
        51262023-01-16late20.99
        web_sessions40,000 rows · 7 columns
        • session_idinteger
        • customer_idinteger
        • started_attimestamp
        • devicevarchar
        • sourcevarchar
        • pages_viewedinteger
        • convertedboolean
        First 5 rows of web_sessions
        session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
        1NULL2023-01-01 23:02:24mobilepaid1false
        2182023-01-01 15:07:49desktoppaid1false
        3NULL2023-01-01 16:55:46desktopdirect7false
        4NULL2023-01-01 12:43:28mobileorganic3false
        5NULL2023-01-01 13:06:21mobilesocial2false
        customers2,018 rows · 9 columns
        • customer_idinteger
        • first_namevarchar
        • last_namevarchar
        • emailvarchar
        • cityvarchar
        • statevarchar
        • signup_datedate
        • segmentvarchar
        • referral_sourcevarchar
        First 5 rows of customers
        customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
        1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
        2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNULL
        3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNULL
        4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
        5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNULL
        products120 rows · 8 columns
        • product_idinteger
        • namevarchar
        • categoryvarchar
        • subcategoryvarchar
        • unit_pricedecimal
        • unit_costdecimal
        • launched_ondate
        • is_activeboolean
        First 5 rows of products
        product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
        101Vale Velvet LoveseatFurnitureSofas1659.00NULL2023-09-11true
        102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
        103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
        104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
        105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
        orders12,000 rows · 7 columns
        • order_idinteger
        • customer_idinteger
        • order_datetimestamp
        • statusvarchar
        • channelvarchar
        • shipping_feedecimal
        • coupon_codevarchar
        First 5 rows of orders
        order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
        10011252023-01-01 20:51:19completedweb0.00NULL
        10021562023-01-02 07:58:46completedweb0.00NULL
        1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
        1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
        1005822023-01-02 11:43:36completedweb0.00WELCOME10
        employees60 rows · 8 columns
        • employee_idinteger
        • first_namevarchar
        • last_namevarchar
        • departmentvarchar
        • titlevarchar
        • manager_idinteger
        • hire_datedate
        • salaryinteger
        First 5 rows of employees
        employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
        1CatherineHaleExecutiveChief Executive OfficerNULL2016-03-01285000
        2RobertKimExecutiveChief Operating Officer12017-01-09235000
        3MeganCollinsSalesHead of Sales12018-04-16172000
        4ChloeGutierrezSalesAccount Executive32020-01-2172000
        5FrankBellSalesAccount Executive32023-05-2173000
        marketing_spend3,276 rows · 3 columns
        • spend_datedate
        • channelvarchar
        • amountdecimal
        First 5 rows of marketing_spend
        spend_datechannelamount
        2023-01-01paid492.99
        2023-01-01email37.38
        2023-01-01social200.53
        2023-01-02paid709.13
        2023-01-02email64.13

        The lesson

        This boss combines the whole chapter: aggregates over expressions, grouping, sorting grouped results, and filtering groups.

        Step 1: top products by revenue

        Compute revenue per line, sum per product, then rank:

        SELECT product_id,
               SUM(quantity) AS units,
               ROUND(SUM(quantity * unit_price * (1 - discount_pct / 100.0)), 2) AS net_revenue
        FROM order_items
        WHERE quantity > 0
        GROUP BY product_id
        ORDER BY net_revenue DESC, product_id
        LIMIT 10;

        This includes every order status because the order status lives in a different table. In chapter 5 you will join orders and count only completed orders, which is what finance would usually want. When you hand this to Megan, say which version it is.

        Step 2: returns by reason

        Three aggregates side by side. A useful pattern when presenting: count, total and average together tell you whether a reason is expensive because it is frequent or because each return is large. “Damaged” returns might be fewer than “changed_mind” but cost more each, which points to a packaging problem rather than a product problem.

        Step 3: conversion rate by source

        converted is a boolean. To count the true values, turn it into 1 or 0 and sum:

        SUM(CAST(converted AS INTEGER)) AS conversions

        This works in Postgres, DuckDB and MySQL. BigQuery spells it CAST(converted AS INT64) or COUNTIF(converted). Postgres and DuckDB also support the standard COUNT(*) FILTER (WHERE converted), and every database supports SUM(CASE WHEN converted THEN 1 ELSE 0 END), which you will meet in chapter 6.

        The conversion rate is conversions over sessions. Multiply by 100.0 before dividing, so integer division in Postgres cannot turn every rate into 0. Then HAVING COUNT(*) >= 5000 drops small sources, whose rates are too noisy to compare.

        Small groups lie

        Why filter out small groups? A source with 40 sessions and 4 conversions shows a 10% rate, which may look better than a source with 20,000 sessions at 3%. The small one is mostly noise. Analysts routinely set a minimum sample size with HAVING before ranking groups by a rate. Mention the threshold in your notes so nobody wonders where a source went.