1. Lighthouse

Level 8 · Conversion by device and source

The request

From Priya Shah, Head of Data

“Jordan wants to know where to put next quarter's budget. Rank every device and traffic source combination by conversion rate, but leave out combinations with fewer than 1,000 sessions. Their rates jump around too much to plan on.”

Your goal

Set result to a DataFrame from web_sessions with one row per device and source combination that has at least 1,000 sessions: columns device, source, sessions (number of sessions), conversions (number of converted sessions) and conv_rate (conversions / sessions, rounded to 3), sorted by conv_rate descending, index reset.

  • Use the web_sessions DataFramenot done yet
  • Show exactly device source sessions conversions conv_ratenot done yet
  • 11 rows, sorted as askednot done yet

Your code

Python

Loading the editor…

    ResultPreview of web_sessions · press Run to see yours
    Preview of web_sessions
    session_idcustomer_idstarted_atdevicesource
    1NaN2023-01-01 23:02:24mobilepaid
    2182023-01-01 15:07:49desktoppaid
    3NaN2023-01-01 16:55:46desktopdirect
    4NaN2023-01-01 12:43:28mobileorganic

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13

    The lesson

    Counts and rates from a boolean column

    converted is True or False for each session. That makes it two measures in one:

    web_sessions["converted"].sum()    # 1193 sessions converted
    web_sessions["converted"].mean()   # 0.0298, about 3% of all sessions

    Inside a groupby the same trick works per group. One agg with two keys builds everything Priya needs:

    combos = web_sessions.groupby(["device", "source"], as_index=False).agg(
        sessions=("session_id", "size"),
        conversions=("converted", "sum"),
        conv_rate=("converted", "mean"),
    )

    The mean of converted is exactly conversions / sessions, so you don’t need a separate division. Five sources times three devices gives 15 combinations.

    Filter the groups, not the rows

    The rule “at least 1,000 sessions” is about groups, so it has to come after the aggregation. The summary is an ordinary DataFrame, so a normal mask does it:

    combos[combos["sessions"] >= 1000]

    Four combinations drop out, all on tablets: email (447 sessions), social (642), direct (599) and paid (876). Tablets are only about a tenth of the traffic, so they rarely reach the threshold. Tablet email is the interesting loss: 41 conversions out of 447 is 9.2%, which would rank second. It may be real, but a few lucky days could move it a lot. That’s exactly why Priya asked for a floor.

    Reading the ranking

    Email converts best on every device, and desktop email leads at 12.8%. Social is last everywhere, with mobile social at 0.4%. The biggest combination, mobile organic with 7,252 sessions, converts at only 1.5%. Lots of traffic and a strong rate are different things, and a budget discussion needs both columns side by side. Keep sessions and conversions in the table even though the ranking only uses the rate: they let anyone reading it judge how solid each number is.

    Common mistakes

    • Filtering before grouping, for example on pages_viewed, which changes the rates themselves.
    • Using "count" on converted for conversions. It counts sessions, not True values.
    • Averaging per-device rates to get a per-source rate. Groups have different sizes, so divide totals instead.
    • Writing the threshold as > 1000 when the ticket says “at least 1,000”. On other data that would drop a combination with exactly 1,000 sessions.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.