1. Lighthouse

Level 1 · Rows by position, columns by name

The request

From Thomas Whitaker, Head of Merchandising

“I'm reviewing the catalog in batches of five. Could you send me the next batch, products 11 to 15 in table order, with just name, category and price?”

Your goal

Set result to a DataFrame with the rows at positions 10 to 14 of products (the 11th to the 15th row, 5 rows) and only the columns name, category, unit_price, in that order.

  • Use the products DataFramenot done yet
  • Show exactly name category unit_pricenot done yet
  • 5 rows, sorted as askednot done yet

Your code

Python

Loading the editor…

    ResultPreview of products · press Run to see yours
    Preview of products
    product_idnamecategorysubcategoryunit_price
    101Vale Velvet LoveseatFurnitureSofas1659.00
    102Alder Oak Coffee TableFurnitureTables919.00
    103Orchard Rattan Dining ChairFurnitureChairs789.00
    104Upland Oak BookcaseFurnitureStorage429.00

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    Two ways to point at rows

    Every DataFrame row has a position (0 for the first row, 1 for the second, and so on) and an index label (the value shown on the left). Right after loading a CSV they are the same numbers, which hides the difference. After filtering or sorting, they’re not, and picking the wrong one gives you the wrong rows without any error.

    pandas gives you one tool for each:

    • .iloc selects by integer position.
    • .loc selects by label: index labels for rows, column names for columns.

    iloc: positions

    .iloc works like Python list slicing, end excluded:

    products.iloc[0]          # first row, as a Series
    products.iloc[10:15]      # positions 10, 11, 12, 13, 14
    products.iloc[-3:]        # last three rows
    products.iloc[10:15, 1:4] # same rows, columns at positions 1 to 3

    Column positions are fragile, because adding a column shifts them. So in practice you’ll usually pick rows with .iloc and columns by name in a second step:

    products.iloc[10:15][["name", "category", "unit_price"]]

    loc: labels

    .loc[rows, columns] takes labels for both:

    products.loc[10:14, ["name", "category", "unit_price"]]
    products.loc[:, ["name", "unit_price"]]     # all rows, two columns
    products.loc[3, "name"]                     # one cell

    Important: label slices in .loc include the end. products.loc[10:14] returns five rows, labels 10 through 14. That’s because labels aren’t always numbers (they can be dates or names), and “from Monday to Friday” should include Friday.

    When labels and positions drift apart

    Sort the products by price and the index labels travel with their rows:

    by_price = products.sort_values("unit_price", ascending=False)
    by_price.iloc[0]       # the most expensive product (position 0)
    by_price.loc[0]        # the row whose label is 0, wherever it ended up

    If you meant “the first row”, iloc is right and loc silently gives you a different product. That’s why you shouldn’t rely on index labels after reshaping the data unless you set them on purpose, for example with reset_index(drop=True) or set_index("product_id").

    Using a meaningful index

    You can make an ID column the index, then look rows up by ID:

    by_id = products.set_index("product_id")
    by_id.loc[102, "name"]        # 'Alder Oak Coffee Table'
    by_id.loc[[101, 102, 103]]    # several products at once

    This is the pandas version of a dictionary lookup, and it’s handy when you need the same rows repeatedly.

    The one-step rule

    When you want to change values, do it in one .loc call: df.loc[row_selector, "column"] = value. Chaining two selections, such as df[df["x"] > 0]["column"] = value, may modify a temporary copy instead of df. Modern pandas warns about this (and pandas 3 never modifies the original that way), so form the habit now.

    Common mistakes

    • Expecting products.loc[10:15] to give five rows. It gives six, because .loc includes the end.
    • Using .loc[0] after a sort to get the top row.
    • Mixing positions and names in one .iloc call: products.iloc[10:15, "name"] fails, since .iloc only accepts integers.