1. Lighthouse

Level 9 · Stray spaces in states and cities

The request

From Tyler Morgan, Junior Data Engineer

“I'm adding a cleanup step to the customer pipeline. Before I write it, I want the rows where the state isn't exactly two characters, or the city starts or ends with a space. Can you pull them?”

Your goal

From customers, return customer_id, city and state for customers whose state is not exactly two characters long, or whose city starts with a space, or whose city ends with a space. Use LIKE / NOT LIKE patterns.

  • Read from the customers tablenot done yet
  • Show exactly customer_id city statenot done yet
  • 80 rowsnot done yet

Your query

SQL

Loading the editor…

    ResultPreview of customers · press Run to see yours
    Preview of customers
    customer_idfirst_namelast_nameemailcity
    1OwenHudsonowen.hudson@icloud.comSan Francisco
    2DouglasMendozadmendoza69@gmail.comAtlanta
    3HenryBrookshbrooks@lakesidecafe.comLos Angeles
    4BrianGrahambgraham@bluecedarhomes.comSeattle

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    Tables

    Harbor & Pine store data, ready to query.

    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNULL
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNULL
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNULL
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NULL2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NULL
    10021562023-01-02 07:58:46completedweb0.00NULL
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNULL2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NULL2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NULL2023-01-01 16:55:46desktopdirect7false
    4NULL2023-01-01 12:43:28mobileorganic3false
    5NULL2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    % matches any run of characters, including none. Its sibling _ matches exactly one character. That makes LIKE useful for shapes and lengths, not only for “contains” searches.

    Patterns for length and position

    SELECT COUNT(*) AS padded_states
    FROM customers
    WHERE state NOT LIKE '__';

    That returns 29. Every US state code is two letters, so a value that is not exactly two characters has something extra, here a space before or after the code (’ MO’, ‘DC ’). NOT LIKE simply keeps the rows where the pattern does not match.

    Position works the same way. ' %' means “a space, then anything”, so it finds leading spaces; '% ' finds trailing ones. On city those two patterns find 51 customers, such as ’ detroit ’ and ‘San Francisco ’. Other fixed shapes follow the same idea: 'WELCOME__' would match WELCOME plus exactly two more characters.

    Tyler’s three conditions are alternatives, so they are joined with OR. There is no AND in the WHERE, so no parentheses are needed. The 14 customers with a NULL city match none of the city patterns; LIKE on NULL is unknown, like every comparison with NULL.

    What patterns miss

    LIKE is case-sensitive in DuckDB and Postgres, but _ matches any character, so a lowercase ‘ca’ is two characters and passes. The schema notes 45 messy states in total: these 29 padded ones plus 16 lowercase ones. A full cleanup compares the value with its cleaned version, which chapter 6 covers.

    Common mistakes

    • Writing state LIKE '_' for “two characters”. Each _ is one character, so you need two.
    • Using = with wildcards. city = ' %' looks for the literal text space-percent and finds nothing.
    • Forgetting that % also matches zero characters, so '% ' matches a single space too.

    In SQL Server

    LIKE, %, _ and NOT LIKE work the same. SQL Server also has character classes, which DuckDB’s LIKE does not: LIKE '[A-M]%' (starts with A to M) or LIKE '%[0-9][0-9]' (ends in two digits). Its default collation is case-insensitive, so LIKE 'ca' would also match ‘CA’ there.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.