The request

From Thomas Whitaker, Head of Merchandising
Your goal
Set result to a DataFrame with one row per category and columns category, n_products (number of products), avg_price (mean unit_price, rounded to 2) and max_price (max unit_price), sorted by category A to Z, with category as a regular column (not the index).
- Use the
productsDataFramenot done yet - Show exactly
categoryn_productsavg_pricemax_pricenot done yet - 6 rows, sorted as askednot done yet
Your code
Loading the editor…
Reference solution
| product_id | name | category | subcategory | unit_price |
|---|---|---|---|---|
| 101 | Vale Velvet Loveseat | Furniture | Sofas | 1659.00 |
| 102 | Alder Oak Coffee Table | Furniture | Tables | 919.00 |
| 103 | Orchard Rattan Dining Chair | Furniture | Chairs | 789.00 |
| 104 | Upland Oak Bookcase | Furniture | Storage | 429.00 |
Mote checks your result
Press Run. Each row that matches the goal becomes a firefly in your lantern.
What Thomas gets, and why
DataFrames
Loaded for you as pandas DataFrames, plus pd and np.
products120 rows · 8 columns
product_idintegernamevarcharcategoryvarcharsubcategoryvarcharunit_pricedecimalunit_costdecimallaunched_ondateis_activeboolean
| product_id | name | category | subcategory | unit_price | unit_cost | launched_on | is_active |
|---|---|---|---|---|---|---|---|
| 101 | Vale Velvet Loveseat | Furniture | Sofas | 1659.00 | NaN | 2023-09-11 | true |
| 102 | Alder Oak Coffee Table | Furniture | Tables | 919.00 | 503.50 | 2024-05-16 | true |
| 103 | Orchard Rattan Dining Chair | Furniture | Chairs | 789.00 | 429.87 | 2023-05-27 | true |
| 104 | Upland Oak Bookcase | Furniture | Storage | 429.00 | 214.70 | 2022-12-20 | true |
| 105 | Avery Leather Bed Frame | Furniture | Beds | 449.00 | 232.70 | 2021-08-31 | true |
customers2,018 rows · 9 columns
customer_idintegerfirst_namevarcharlast_namevarcharemailvarcharcityvarcharstatevarcharsignup_datedatesegmentvarcharreferral_sourcevarchar
| customer_id | first_name | last_name | city | state | signup_date | segment | referral_source | |
|---|---|---|---|---|---|---|---|---|
| 1 | Owen | Hudson | owen.hudson@icloud.com | San Francisco | CA | 2022-06-02 | consumer | search |
| 2 | Douglas | Mendoza | dmendoza69@gmail.com | Atlanta | GA | 2022-06-02 | consumer | NaN |
| 3 | Henry | Brooks | hbrooks@lakesidecafe.com | Los Angeles | CA | 2022-06-04 | business | NaN |
| 4 | Brian | Graham | bgraham@bluecedarhomes.com | Seattle | WA | 2022-06-06 | business | |
| 5 | Kyle | Jimenez | kjimenez27@yahoo.com | Indianapolis | IN | 2022-06-07 | consumer | NaN |
orders12,000 rows · 7 columns
order_idintegercustomer_idintegerorder_datetimestampstatusvarcharchannelvarcharshipping_feedecimalcoupon_codevarchar
| order_id | customer_id | order_date | status | channel | shipping_fee | coupon_code |
|---|---|---|---|---|---|---|
| 1001 | 125 | 2023-01-01 20:51:19 | completed | web | 0.00 | NaN |
| 1002 | 156 | 2023-01-02 07:58:46 | completed | web | 0.00 | NaN |
| 1003 | 22 | 2023-01-02 10:25:27 | completed | marketplace | 4.99 | WELCOME10 |
| 1004 | 48 | 2023-01-02 11:21:51 | completed | marketplace | 4.99 | WELCOME10 |
| 1005 | 82 | 2023-01-02 11:43:36 | completed | web | 0.00 | WELCOME10 |
order_items30,338 rows · 6 columns
order_item_idintegerorder_idintegerproduct_idintegerquantityintegerunit_pricedecimaldiscount_pctdecimal
| order_item_id | order_id | product_id | quantity | unit_price | discount_pct |
|---|---|---|---|---|---|
| 1 | 1001 | 121 | 9 | 31.99 | 0.00 |
| 2 | 1001 | 154 | 3 | 11.99 | 0.00 |
| 3 | 1002 | 154 | 4 | 11.99 | 0.00 |
| 4 | 1002 | 194 | 1 | 149.00 | 0.00 |
| 5 | 1002 | 193 | 2 | 19.99 | 0.00 |
returns1,673 rows · 5 columns
return_idintegerorder_item_idintegerreturned_ondatereasonvarcharrefund_amountdecimal
| return_id | order_item_id | returned_on | reason | refund_amount |
|---|---|---|---|---|
| 1 | 14 | 2023-01-10 | damaged | 83.69 |
| 2 | 42 | 2023-01-10 | wrong_item | 19.99 |
| 3 | 105 | 2023-01-14 | wrong_item | 10.99 |
| 4 | 24 | 2023-01-16 | changed_mind | 26.99 |
| 5 | 126 | 2023-01-16 | late | 20.99 |
employees60 rows · 8 columns
employee_idintegerfirst_namevarcharlast_namevarchardepartmentvarchartitlevarcharmanager_idintegerhire_datedatesalaryinteger
| employee_id | first_name | last_name | department | title | manager_id | hire_date | salary |
|---|---|---|---|---|---|---|---|
| 1 | Catherine | Hale | Executive | Chief Executive Officer | NaN | 2016-03-01 | 285000 |
| 2 | Robert | Kim | Executive | Chief Operating Officer | 1 | 2017-01-09 | 235000 |
| 3 | Megan | Collins | Sales | Head of Sales | 1 | 2018-04-16 | 172000 |
| 4 | Chloe | Gutierrez | Sales | Account Executive | 3 | 2020-01-21 | 72000 |
| 5 | Frank | Bell | Sales | Account Executive | 3 | 2023-05-21 | 73000 |
web_sessions40,000 rows · 7 columns
session_idintegercustomer_idintegerstarted_attimestampdevicevarcharsourcevarcharpages_viewedintegerconvertedboolean
| session_id | customer_id | started_at | device | source | pages_viewed | converted |
|---|---|---|---|---|---|---|
| 1 | NaN | 2023-01-01 23:02:24 | mobile | paid | 1 | false |
| 2 | 18 | 2023-01-01 15:07:49 | desktop | paid | 1 | false |
| 3 | NaN | 2023-01-01 16:55:46 | desktop | direct | 7 | false |
| 4 | NaN | 2023-01-01 12:43:28 | mobile | organic | 3 | false |
| 5 | NaN | 2023-01-01 13:06:21 | mobile | social | 2 | false |
marketing_spend3,276 rows · 3 columns
spend_datedatechannelvarcharamountdecimal
| spend_date | channel | amount |
|---|---|---|
| 2023-01-01 | paid | 492.99 |
| 2023-01-01 | 37.38 | |
| 2023-01-01 | social | 200.53 |
| 2023-01-02 | paid | 709.13 |
| 2023-01-02 | 64.13 |
The lesson
Several numbers per group
A summary table usually needs more than one statistic. agg computes several at once. The clearest
form is named aggregation: each keyword is the name of an output column, and its value is a
(column, function) pair.
products.groupby("category").agg(
n_products=("product_id", "count"),
avg_price=("unit_price", "mean"),
max_price=("unit_price", "max"),
)
You decide the column names up front, so there’s no renaming afterwards and no confusing multi-level headers. This is the style to use in shared code.
The function can be a string ("sum", "mean", "median", "min", "max", "count",
"size", "nunique", "first") or any function that takes a Series and returns one value:
products.groupby("category").agg(
price_range=("unit_price", lambda s: s.max() - s.min()),
)
Keeping the key as a column
By default the group keys become the index. With as_index=False, they stay a regular column, which
is what you want for a table you’ll sort, merge or export:
products.groupby("category", as_index=False).agg(...)
Calling .reset_index() after a normal groupby gives the same shape.
Rounding selected columns
DataFrame.round accepts a dictionary, so you can round only what needs it:
summary.round({"avg_price": 2})
Rounding the whole table with .round(2) is fine too, since counts are whole numbers anyway. Just
avoid rounding the raw price column before averaging, which would change the result.
Other aggregation styles you’ll see
Older code and tutorials use other forms. They work, but produce less predictable column names:
products.groupby("category")["unit_price"].agg(["mean", "max"]) # columns: mean, max
products.groupby("category").agg({"unit_price": ["mean", "max"]}) # two-level column headers
The dictionary form gives a MultiIndex for the columns (("unit_price", "mean")), which is
awkward to work with. Named aggregation avoids it.
Counting products
("product_id", "count") counts non-missing IDs. Since IDs are never missing, that equals the
number of rows. For a count of distinct products in a table where they repeat, such as order lines,
use ("product_id", "nunique") instead. Choosing between count, size and nunique is a
correctness decision, not a style one.
Reading the result
Every category has 20 products, so the interesting columns are the prices. Furniture’s average is far higher than Decor’s; compare the average with the maximum to spot categories where one or two premium items pull the average up.
Common mistakes
- Writing
n_products=("product_id", count)with the bare namecount, which isn’t defined. Use the string"count"(or the built-inlen). - Forgetting
as_index=False, socategoryis the index and not a column. - Mistyping the column inside the tuple:
("price", "mean")raisesKeyError.
If you know SQL
Named aggregation is the pandas version of
SELECT category, COUNT(product_id) AS n_products, AVG(unit_price) AS avg_price ....
Lantern lit!
Practised: named aggregationaggas indexmultiple aggregations
- Solved
- No hints
- First run
