Differences

This shows you the differences between two versions of the page.

--- vd-pge [2021/08/10 09:50] – dblume
+++ vd-pge [2023/04/12 20:44] (current) – external edit 127.0.0.1
@@ Line 1: / Line 1: @@
 ====== Analyzing PG&E data with VisiData ======
-PG&E CSVs come with 5 rows of metadata followed by Type, Date, Start Time, End Time, Usage, Units, Cost, Notes columns. Delete the five rows of metadata in a text editor, or use ''tail'' to remove them like so:
+At the PG&E website, you can download a CSV table of your energy usage. Click "Energy Usage Details" and then the "Green Button" at their site to download your data.
+{{:general:vd-pge-green-button.png?direct|}}
+PG&E CSVs come with 5 rows of metadata followed by ''Type'', ''Date'', ''Start Time'', ''End Time'', ''Usage'', ''Units'', ''Cost'', ''Notes'' columns. Delete the five rows of metadata in a text editor, or use ''tail'' to remove them like so (or with ''tail -n +6'' for older tail):
     tail +6 pge_electric_interval_data.csv | vd -f csv -
@@ Line 17: / Line 21: @@
 | t | Select the DATE and START TIME columns |
 | & | Make a new column that merges them |
-| q, - | Quit the Column mode, hide DATE and START TIME columns |
+| - | (Optionally delete some columns' rows from column mode to really delete columns from the sheet.) |
+| q, - | Quit the Column mode, hide (sets their width to 0) DATE and START TIME columns |
 | O | Go to options mode and... |
-| e | Set ''disp_date_fmt'' to ''%Y-%m-%d %H:%M'' (or do it in C column mode for the one column.) |
+| e | Set ''disp_date_fmt'' to ''%Y-%m-%d %H:%M'' (or do it in column mode's ''fmtstr'' for the one column.) |
 | q | Quit options mode. |
 | @!, %, $ | Set DATE_START_TIME to date format and important, USAGE to float, COST to currency |
@@ Line 46: / Line 51: @@
 {{:general:vd-pge-graph-by-hour-of-day.png?direct|}}
-===== View average usage by hour by day of week =====
+===== View average usage by day of week =====
 ^ Key ^ Meaning ^
 | - | Hide all columns, leaving only ''wday_num'', ''time'', ''USAGE'', and ''COST'' |
 | C, t, & | Column mode, toggle ''wday_num'', ''time'', make a new column that joins them. |
+| = | With ''TIME'' as string format, make a new row as ''int(int(TIME[:2])/4)*4'' |
 ===== Select Rows to Analyze =====
+Directly selecting ranges of rows:
 ^ Key ^ Meaning ^
-| %%|%% | On DATE_START_TIME column, select by regex, like "-11-" for November |
+| s,t,u | Select/toggle/unselect current row. |
-| " | To open a new sheet with just those selected rows. |
+| , | Select all rows matching value of current cell |
-| q | Quit the new sheet mode. |
+| gs,gt,gu | ... all rows |
+| zs,zt,zu | ... from top to cursor |
+| gzs,gzt,gzu | ... from cursor to bottom (Or... ''zs,gt'', one less thing to remember) |
+| " | Open duplicate sheet with only selected rows. |
+Select based on a pattern:
 ^ Key ^ Meaning ^
-| %%z|%% | select rows matching Python expr "DATE_START_TIME [-3:] == '-07'" |
+| %%|%% | On DATE_START_TIME column, select by regex, like "-11-" for November |
+| %%z|%% | Select rows matching Python expr "DATE_START_TIME [-3:] == '-07'" |
 | " | To open a new sheet with just those selected rows. |
-| q | Quit the new sheet mode. |
 ===== Visualize Data =====
@@ Line 69: / Line 83: @@
 | . or g. | Select columns to graph them. Notice rate changes. Notice times of high use. |
 | +, - | Navigate with hjkl, zoom in and out ([[https://www.visidata.org/docs/graph/|more]]) |
+====== Further Resources ======
+I have another tutorial at [[vd]] that merges/joins three CSV tables.