1. Lighthouse

Level 3 · Revenue by category, completed orders only

The request

From Laura Bennett, Head of Finance

“For the annual review I need line revenue by product category, counting completed orders only. Biggest category first.”

Your goal

Set result to a DataFrame with columns category and revenue: the sum of line revenue (quantity * unit_price * (1 - discount_pct / 100), using order_items.unit_price) over lines whose order has status 'completed', rounded to 2, one row per category, sorted by revenue descending, index reset.

  • Use the products DataFramenot done yet
  • Use the orders DataFramenot done yet
  • Show exactly category revenuenot done yet

Your code

Python

Loading the editor…

    ResultPreview of products · press Run to see yours
    Preview of products
    product_idnamecategorysubcategoryunit_price
    101Vale Velvet LoveseatFurnitureSofas1659.00
    102Alder Oak Coffee TableFurnitureTables919.00
    103Orchard Rattan Dining ChairFurnitureChairs789.00
    104Upland Oak BookcaseFurnitureStorage429.00

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    Three tables, one question

    “Revenue by category for completed orders” touches three tables:

    • order_items has the revenue ingredients (quantity, price paid, discount).
    • orders has the status.
    • products has the category.

    There’s no single merge that does it all, but merges chain naturally, one key at a time:

    items.merge(orders, on="order_id").merge(products, on="product_id")

    Compute before you merge

    Calculate line revenue on order_items before merging with products. After the merge there are two unit_price columns, and it’s easy to pick the list price by accident. Today’s list price is wrong for revenue on lines sold before the March 2025 price rise.

    items = order_items.assign(
        line_revenue=order_items["quantity"] * order_items["unit_price"]
        * (1 - order_items["discount_pct"] / 100)
    )

    Merge only what you need

    Bring in just the key and the columns you need from each table. It keeps the result narrow and avoids name clashes:

    completed_ids = orders.loc[orders["status"] == "completed", ["order_id"]]
    merged = (
        items
        .merge(completed_ids, on="order_id", how="inner", validate="many_to_one")
        .merge(products[["product_id", "category"]], on="product_id", how="inner", validate="many_to_one")
    )

    Notice the first merge does the filtering. An inner join with a list of completed order IDs keeps only lines from completed orders. That’s a common and tidy pattern: filtering by joining. You could do the same with items[items["order_id"].isin(completed_ids["order_id"])]; both are fine.

    Each merge is many-to-one (many lines per order, many lines per product), and validate checks it.

    Then group

    (
        merged.groupby("category", as_index=False)
        .agg(revenue=("line_revenue", "sum"))
        .round({"revenue": 2})
        .sort_values("revenue", ascending=False)
        .reset_index(drop=True)
    )

    Furniture comes out on top, with Outdoor close behind, even though every category has the same number of products: high prices make up for fewer units sold. A natural follow-up is revenue per unit sold, or the share of total, to see which categories punch above their weight.

    Sanity check against the total

    The category revenues should add up to the total revenue of completed orders:

    result["revenue"].sum()
    items[items["order_id"].isin(completed_ids["order_id"])]["line_revenue"].sum()

    If the first is bigger, a merge duplicated rows. If it’s smaller, a merge dropped some. This check takes one line and is the best defence against join mistakes.

    Common mistakes

    • Using products.unit_price (list price) instead of the line’s price paid.
    • Filtering on status after merging all of orders, then forgetting to filter at all.
    • Merging the full orders table, which brings in customer_id, channel and more columns you don’t need.

    If you know SQL

    This is FROM order_items JOIN orders USING (order_id) JOIN products USING (product_id) WHERE status = 'completed' GROUP BY category.