1. Lighthouse

Level 4 · Lapsed customers with EXCEPT

The request

From Lauren Hayes, Email Marketing Manager

“I'm planning a win-back email. Who bought from us in 2024 but hasn't completed a single order in 2025? I need their names and email addresses.”

Your goal

Return customer_id, first_name, last_name and email (from customers) for every customer who has at least one completed order in 2024 and no completed order in 2025. One row per customer.

  • Read from the customers tablenot done yet
  • Read from the orders tablenot done yet
  • Show exactly customer_id first_name last_name emailnot done yet

Your query

SQL

Loading the editor…

    ResultPreview of customers · press Run to see yours
    Preview of customers
    customer_idfirst_namelast_nameemailcity
    1OwenHudsonowen.hudson@icloud.comSan Francisco
    2DouglasMendozadmendoza69@gmail.comAtlanta
    3HenryBrookshbrooks@lakesidecafe.comLos Angeles
    4BrianGrahambgraham@bluecedarhomes.comSeattle

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    Tables

    Harbor & Pine store data, ready to query.

    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNULL
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNULL
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNULL
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NULL
    10021562023-01-02 07:58:46completedweb0.00NULL
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NULL2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNULL2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NULL2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NULL2023-01-01 16:55:46desktopdirect7false
    4NULL2023-01-01 12:43:28mobileorganic3false
    5NULL2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    EXCEPT returns the rows of the first query that do not appear in the second. It is the “subtract” of set operations, and the order of the two queries matters.

    The query

    SELECT customer_id FROM orders
    WHERE status = 'completed' AND order_date >= '2024-01-01' AND order_date < '2025-01-01'
    EXCEPT
    SELECT customer_id FROM orders
    WHERE status = 'completed' AND order_date >= '2025-01-01' AND order_date < '2026-01-01';

    Of the 997 customers who completed an order in 2024, 752 also bought in 2025 (the previous level), and 245 did not. Like UNION and INTERSECT, plain EXCEPT returns distinct rows, so each lapsed customer appears once. Swap the two queries and you get a different question: 2025 buyers who did not buy in 2024.

    Putting the set operation inside a CTE and joining or filtering afterwards is the clean pattern: the comparison happens on customer_id alone, and names and emails are added once the list is final.

    EXCEPT ALL

    EXCEPT ALL (supported in DuckDB and Postgres) works on counts instead of distinct rows: each row on the right cancels one matching row on the left. On these branches, which are one row per order, it returns 1,564 rows. That number is neither customers nor orders of lapsed customers, it is “2024 orders left over after cancelling one per 2025 order”. You rarely want it for people lists. It is useful for reconciling two copies of the same table, where duplicates are real rows.

    EXCEPT, NOT EXISTS and NOT IN

    The same “in A but not in B” can be written three ways, and they differ on NULLs. Take customers who never had a web session. web_sessions.customer_id is NULL for anonymous visits:

    SELECT customer_id FROM customers
    EXCEPT
    SELECT customer_id FROM web_sessions;          -- 205 rows

    NOT EXISTS with a correlated subquery also returns 205. But WHERE customer_id NOT IN (SELECT customer_id FROM web_sessions) returns 0: once the list contains a NULL, NOT IN can never be true. EXCEPT treats NULLs as equal to each other and simply compares rows, so it is immune to that trap. Chapter 11 has a full level on the NOT IN bug.

    Common mistakes

    • Wrong direction. Read it as “A, except the ones also in B” and check the first query is A.
    • Different filters in the two branches. If the 2025 branch forgets status = 'completed', a customer whose only 2025 order was cancelled stops counting as lapsed.
    • Extra columns in the comparison. SELECT customer_id, channel would call a customer lapsed if they only switched channel.
    • Calling 245 a churn rate. It is a count. The rate is 245 / 997 = 24.6% of 2024 buyers.

    In SQL Server

    EXCEPT works the same in SQL Server, but there is no EXCEPT ALL. Oracle calls it MINUS (EXCEPT from 21c), and MySQL supports EXCEPT from 8.0.31, so older code uses NOT EXISTS.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.