1. Lighthouse

Level 6 · Our top cities, counted properly

The request

From Daniel Brooks, Head of Operations

“We're picking cities for same-day delivery. Give me our ten cities with the most customers. Last time the list had Chicago twice, so please clean the names first.”

Your goal

Clean city in customers by stripping spaces and converting it to title case. Set result to a DataFrame with columns city (the cleaned name) and n_customers, for the 10 cities with the most customers, sorted by n_customers descending then city ascending, index reset. Customers with a missing city are left out.

  • Use the customers DataFramenot done yet
  • Show exactly city n_customersnot done yet
  • 10 rows, sorted as askednot done yet

Your code

Python

Loading the editor…

    ResultPreview of customers · press Run to see yours
    Preview of customers
    customer_idfirst_namelast_nameemailcity
    1OwenHudsonowen.hudson@icloud.comSan Francisco
    2DouglasMendozadmendoza69@gmail.comAtlanta
    3HenryBrookshbrooks@lakesidecafe.comLos Angeles
    4BrianGrahambgraham@bluecedarhomes.comSeattle

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    One city, many spellings

    customers["city"] was typed in by people, and it shows. New York appears as New York, NEW YORK and new york, sometimes with spaces around it. To pandas those are different values, so any count splits the city into pieces:

    customers["city"].nunique()                              # 129
    customers["city"].str.strip().str.title().nunique()      # 61

    .str.strip() removes spaces at both ends, and .str.title() capitalizes the first letter of each word and lowercases the rest. Together they map every spelling onto one clean name. Checking nunique() before and after is a quick way to see how much the cleaning merged. Look at the cleaned values once, too: title() can mangle names like “McAllen” into “Mcallen”. In this table the 61 cleaned names, St. Louis included, all come out right.

    Count, then rank with a tie-breaker

    After cleaning, a groupby count per city gives the numbers Daniel wants:

    city raw count cleaned count
    New York 175 181
    Los Angeles 123 124
    Chicago 102 106
    Dallas 78 83

    The raw column undercounts every big city, because the variants are counted separately. The cleaned ranking also changes places further down: Philadelphia (64) moves ahead of Miami (63).

    Phoenix and Boston both have 58 customers, right at the edge of the top ten. Sorting by n_customers alone would leave their order to chance. Adding city as a second key, ascending, makes Boston ninth and Phoenix tenth every time, and Atlanta (57) just misses the list.

    Missing cities

    14 customers have no city at all. They show up as NaN, and groupby leaves NaN keys out by default, which is what Daniel needs: you can’t deliver same-day to an unknown city. If you ever need to count them, customers["city"].isna().sum() gives 14.

    Common mistakes

    • Counting before cleaning, so New York shows up as several smaller cities.
    • Using .str.upper() or .str.lower() and then mismatching the expected names: the ticket wants title case.
    • Calling .strip() without .str, which fails on a Series.
    • Forgetting the tie-breaker on city.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.