1. Lighthouse

Level 3 · Orders by channel and status

The request

From Megan Collins, Head of Sales

“How are our channels doing? I'd like order counts for each channel, split by order status, so I can see cancellations next to completed orders.”

Your goal

From orders, return channel, status and orders (the number of orders) for every combination of channel and status that exists.

  • Read from the orders tablenot done yet
  • Show exactly channel status ordersnot done yet
  • 12 rowsnot done yet

Your query

SQL

Loading the editor…

    ResultPreview of orders · press Run to see yours
    Preview of orders
    order_idcustomer_idorder_datestatuschannel
    10011252023-01-01 20:51:19completedweb
    10021562023-01-02 07:58:46completedweb
    1003222023-01-02 10:25:27completedmarketplace
    1004482023-01-02 11:21:51completedmarketplace

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    Tables

    Harbor & Pine store data, ready to query.

    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NULL
    10021562023-01-02 07:58:46completedweb0.00NULL
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNULL
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNULL
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNULL
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NULL2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNULL2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NULL2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NULL2023-01-01 16:55:46desktopdirect7false
    4NULL2023-01-01 12:43:28mobileorganic3false
    5NULL2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    GROUP BY splits the rows into groups that share the same values, then runs the aggregate once per group:

    SELECT channel, COUNT(*) AS orders
    FROM orders
    GROUP BY channel;

    That returns one row per channel. Add a second column and you get one row per combination:

    SELECT channel, status, COUNT(*) AS orders
    FROM orders
    GROUP BY channel, status;

    The one rule

    Every column in the SELECT list must either be inside an aggregate function or appear in GROUP BY. This fails in Postgres, DuckDB and BigQuery:

    SELECT channel, status, COUNT(*)
    FROM orders
    GROUP BY channel;   -- error: status is neither grouped nor aggregated

    The database cannot show a single status for a group that contains many statuses. Older MySQL versions (or MySQL with ONLY_FULL_GROUP_BY turned off) silently return an arbitrary status instead of erroring, which is worse. DuckDB has a GROUP BY ALL shortcut that groups by every non-aggregated column; it is handy, but not portable to Postgres or MySQL (BigQuery and Snowflake have added it recently).

    Combinations that do not exist

    GROUP BY only returns groups that have at least one row. If the marketplace channel never had a pending order, there is no “marketplace, pending, 0” row. When a report needs zeros for missing combinations, you build the full grid of combinations and LEFT JOIN the counts onto it, a technique from chapter 5.

    Sorting grouped results

    Grouped results come back in no guaranteed order. Add ORDER BY when it matters, and you can sort by the aggregate’s alias:

    SELECT channel, COUNT(*) AS orders
    FROM orders
    GROUP BY channel
    ORDER BY orders DESC;

    Grouping by expressions

    You can group by any expression, as long as the SELECT list uses the same one:

    SELECT EXTRACT(YEAR FROM order_date) AS order_year, COUNT(*) AS orders
    FROM orders
    GROUP BY EXTRACT(YEAR FROM order_date);

    Postgres, DuckDB, MySQL and BigQuery also accept GROUP BY order_year (the alias) or GROUP BY 1 (the position). Positions are common in analytics code, but names survive edits better.

    Common mistakes

    • Grouping by a high-cardinality column like order_id and wondering why every count is 1.
    • Including an extra column “just to see it”, which splits the groups and changes every number. If you need a descriptive column such as a product name next to its ID, group by both.