1. Lighthouse

Level 3 · Fit a line to spend and revenue

The request

From Brian Mitchell, Finance Analyst

“For the budget model I need the line through our monthly marketing spend and revenue: slope, intercept and how well it fits. I'll take it from there.”

Your goal

Fit a straight line of monthly["revenue"] on monthly["spend"] with np.polyfit(x, y, 1). Set result to a dict: "slope" rounded to 2 decimals, "intercept" rounded to 0 decimals, and "r2" (the squared correlation of the two columns) rounded to 3 decimals.

  • Use the orders DataFramenot done yet
  • Use the order_items DataFramenot done yet
  • Store a dict in resultnot done yet
Monthly marketing spend and revenue, 2023–2025
Monthly marketing spend and revenue, 2023–2025$0$100k$200k$300k$400k$0$20k$40k$60k$80k$27,045, $85,437$23,861, $66,625$28,064, $87,788$28,975, $106,298$29,574, $146,984$27,652, $102,555$30,030, $145,155$29,177, $140,662$30,443, $118,229$31,944, $128,086$53,609, $231,165$41,817, $241,527$31,341, $109,306$28,007, $77,547$31,957, $161,478$31,847, $142,766$34,146, $151,773$30,973, $146,719$33,858, $136,668$33,903, $156,410$34,403, $151,881$36,786, $149,408$62,236, $319,217$52,436, $290,432$35,944, $150,571$31,328, $99,903$36,419, $166,787$36,895, $189,735$40,022, $206,469$38,016, $213,062$39,652, $191,967$40,143, $182,987$39,381, $143,379$42,808, $174,599$70,675, $292,364$59,359, $288,347Marketing spend in the monthRevenue in the month
Monthly marketing spend and revenue, 2023–2025$0$100k$200k$300k$400k$0$20k$40k$60k$80k$27,045, $85,437$23,861, $66,625$28,064, $87,788$28,975, $106,298$29,574, $146,984$27,652, $102,555$30,030, $145,155$29,177, $140,662$30,443, $118,229$31,944, $128,086$53,609, $231,165$41,817, $241,527$31,341, $109,306$28,007, $77,547$31,957, $161,478$31,847, $142,766$34,146, $151,773$30,973, $146,719$33,858, $136,668$33,903, $156,410$34,403, $151,881$36,786, $149,408$62,236, $319,217$52,436, $290,432$35,944, $150,571$31,328, $99,903$36,419, $166,787$36,895, $189,735$40,022, $206,469$38,016, $213,062$39,652, $191,967$40,143, $182,987$39,381, $143,379$42,808, $174,599$70,675, $292,364$59,359, $288,347Marketing spend in the monthRevenue in the month

One dot per month. The five dots far to the right are all Novembers and Decembers.

Show the numbers
Marketing spend in the monthRevenue in the month
$27,045$85,437
$23,861$66,625
$28,064$87,788
$28,975$106,298
$29,574$146,984
$27,652$102,555
$30,030$145,155
$29,177$140,662
$30,443$118,229
$31,944$128,086
$53,609$231,165
$41,817$241,527
$31,341$109,306
$28,007$77,547
$31,957$161,478
$31,847$142,766
$34,146$151,773
$30,973$146,719
$33,858$136,668
$33,903$156,410
$34,403$151,881
$36,786$149,408
$62,236$319,217
$52,436$290,432
$35,944$150,571
$31,328$99,903
$36,419$166,787
$36,895$189,735
$40,022$206,469
$38,016$213,062
$39,652$191,967
$40,143$182,987
$39,381$143,379
$42,808$174,599
$70,675$292,364
$59,359$288,347

Your code

Python

Loading the editor…

    ResultPreview of orders · press Run to see yours
    Preview of orders
    order_idcustomer_idorder_datestatuschannel
    10011252023-01-01 20:51:19completedweb
    10021562023-01-02 07:58:46completedweb
    1003222023-01-02 10:25:27completedmarketplace
    1004482023-01-02 11:21:51completedmarketplace

    Mote checks your result

    Press Run. Each row that matches the goal becomes a firefly in your lantern.

    DataFrames

    Loaded for you as pandas DataFrames, plus pd and np.

    orders12,000 rows · 7 columns
    • order_idinteger
    • customer_idinteger
    • order_datetimestamp
    • statusvarchar
    • channelvarchar
    • shipping_feedecimal
    • coupon_codevarchar
    First 5 rows of orders
    order_idcustomer_idorder_datestatuschannelshipping_feecoupon_code
    10011252023-01-01 20:51:19completedweb0.00NaN
    10021562023-01-02 07:58:46completedweb0.00NaN
    1003222023-01-02 10:25:27completedmarketplace4.99WELCOME10
    1004482023-01-02 11:21:51completedmarketplace4.99WELCOME10
    1005822023-01-02 11:43:36completedweb0.00WELCOME10
    order_items30,338 rows · 6 columns
    • order_item_idinteger
    • order_idinteger
    • product_idinteger
    • quantityinteger
    • unit_pricedecimal
    • discount_pctdecimal
    First 5 rows of order_items
    order_item_idorder_idproduct_idquantityunit_pricediscount_pct
    11001121931.990.00
    21001154311.990.00
    31002154411.990.00
    410021941149.000.00
    51002193219.990.00
    marketing_spend3,276 rows · 3 columns
    • spend_datedate
    • channelvarchar
    • amountdecimal
    First 5 rows of marketing_spend
    spend_datechannelamount
    2023-01-01paid492.99
    2023-01-01email37.38
    2023-01-01social200.53
    2023-01-02paid709.13
    2023-01-02email64.13
    customers2,018 rows · 9 columns
    • customer_idinteger
    • first_namevarchar
    • last_namevarchar
    • emailvarchar
    • cityvarchar
    • statevarchar
    • signup_datedate
    • segmentvarchar
    • referral_sourcevarchar
    First 5 rows of customers
    customer_idfirst_namelast_nameemailcitystatesignup_datesegmentreferral_source
    1OwenHudsonowen.hudson@icloud.comSan FranciscoCA2022-06-02consumersearch
    2DouglasMendozadmendoza69@gmail.comAtlantaGA2022-06-02consumerNaN
    3HenryBrookshbrooks@lakesidecafe.comLos AngelesCA2022-06-04businessNaN
    4BrianGrahambgraham@bluecedarhomes.comSeattleWA2022-06-06businesspinterest
    5KyleJimenezkjimenez27@yahoo.comIndianapolisIN2022-06-07consumerNaN
    products120 rows · 8 columns
    • product_idinteger
    • namevarchar
    • categoryvarchar
    • subcategoryvarchar
    • unit_pricedecimal
    • unit_costdecimal
    • launched_ondate
    • is_activeboolean
    First 5 rows of products
    product_idnamecategorysubcategoryunit_priceunit_costlaunched_onis_active
    101Vale Velvet LoveseatFurnitureSofas1659.00NaN2023-09-11true
    102Alder Oak Coffee TableFurnitureTables919.00503.502024-05-16true
    103Orchard Rattan Dining ChairFurnitureChairs789.00429.872023-05-27true
    104Upland Oak BookcaseFurnitureStorage429.00214.702022-12-20true
    105Avery Leather Bed FrameFurnitureBeds449.00232.702021-08-31true
    returns1,673 rows · 5 columns
    • return_idinteger
    • order_item_idinteger
    • returned_ondate
    • reasonvarchar
    • refund_amountdecimal
    First 5 rows of returns
    return_idorder_item_idreturned_onreasonrefund_amount
    1142023-01-10damaged83.69
    2422023-01-10wrong_item19.99
    31052023-01-14wrong_item10.99
    4242023-01-16changed_mind26.99
    51262023-01-16late20.99
    employees60 rows · 8 columns
    • employee_idinteger
    • first_namevarchar
    • last_namevarchar
    • departmentvarchar
    • titlevarchar
    • manager_idinteger
    • hire_datedate
    • salaryinteger
    First 5 rows of employees
    employee_idfirst_namelast_namedepartmenttitlemanager_idhire_datesalary
    1CatherineHaleExecutiveChief Executive OfficerNaN2016-03-01285000
    2RobertKimExecutiveChief Operating Officer12017-01-09235000
    3MeganCollinsSalesHead of Sales12018-04-16172000
    4ChloeGutierrezSalesAccount Executive32020-01-2172000
    5FrankBellSalesAccount Executive32023-05-2173000
    web_sessions40,000 rows · 7 columns
    • session_idinteger
    • customer_idinteger
    • started_attimestamp
    • devicevarchar
    • sourcevarchar
    • pages_viewedinteger
    • convertedboolean
    First 5 rows of web_sessions
    session_idcustomer_idstarted_atdevicesourcepages_viewedconverted
    1NaN2023-01-01 23:02:24mobilepaid1false
    2182023-01-01 15:07:49desktoppaid1false
    3NaN2023-01-01 16:55:46desktopdirect7false
    4NaN2023-01-01 12:43:28mobileorganic3false
    5NaN2023-01-01 13:06:21mobilesocial2false

    The lesson

    A line through the dots

    A simple linear regression finds the straight line y = slope × x + intercept that sits closest to the points, in the sense that the squared vertical distances from the points to the line add up to as little as possible (“least squares”). In NumPy it is one call:

    slope, intercept = np.polyfit(monthly["spend"], monthly["revenue"], 1)
    # slope ≈ 5.50, intercept ≈ -40,288

    The 1 is the degree: a straight line. The order of the arguments matters: x (the column you predict from) first, y (the one you predict) second. Swap them and you get a different line.

    Reading the slope

    The slope is the change in y per one unit of x. Here: months with $1,000 more marketing spend had about $5,500 more revenue. Read every word of that sentence. It compares months; it describes this data; it says nothing about what happens if you add $1,000 next month. Level 2 showed why: November and December have big budgets and holiday shoppers, so the slope carries both.

    Reading the intercept

    The intercept is the predicted y when x is 0: here, -$40,288 of revenue in a month with no marketing. Negative revenue is impossible. The intercept is just where the line crosses zero, far to the left of every real month (the lowest spend was $23,861). Treat it as a parameter of the line, not a forecast.

    R²: how much of the variation the line follows

    R² (R-squared) is the share of the variation in y around its mean that the line accounts for. For one x it is the correlation squared:

    monthly["spend"].corr(monthly["revenue"]) ** 2   # 0.845

    0.845 means the line follows revenue’s ups and downs closely. It doesn’t mean the line is causal, and it doesn’t mean predictions are accurate to 84.5%. A high R² with a confounder is still a confounded line.

    Common mistakes

    • Swapping x and y in np.polyfit. The slope of revenue on spend is not 1 / (slope of spend on revenue) unless the points sit exactly on a line.
    • Calling the slope a return on investment. It is an association across months.
    • Reading the intercept as a real scenario when x = 0 is far outside the data.
    • Treating a high R² as proof. It measures fit, not cause.

    Pick what may run on this site. You can change this any time from "Cookie settings" at the bottom of every page.