Livedocs
Top 10 Pandas Commands to Uplevel Your Data & AI LLM
hardwaresales.c...
Query Error
An error occurred while querying the file: Parser Error: syntax error at end of input

1 Fundamentals

  • df.read_csv()
  • df.read_json()
  • df.read_parquet()


Every AI workflow stars with data ingestion. Large scale datasets for LLM fine-tuning, embeddings, or ML experiments often come in CSV, JSON, or Parquet formats.

Pandas provides simple functions to load them efficiently and inspect data quickly.


df = pd.read_csv(file_path)

df.head(5)

df.info()

File 'hardwaresales.csv' (ID: 49917290-5813-457d-87bf-094b077002b4) already exists locally at '/livedocs/data/files/hardwaresales.csv'. Use option force_download=True to overwrite. <class 'pandas.core.frame.DataFrame'> RangeIndex: 154 entries, 0 to 153 Data columns (total 13 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 order_id 154 non-null object 1 date 154 non-null object 2 product_category 154 non-null object 3 product_name 154 non-null object 4 brand 154 non-null object 5 quantity 154 non-null int64 6 unit_price 154 non-null float64 7 total_amount 154 non-null float64 8 customer_id 154 non-null object 9 customer_city 154 non-null object 10 customer_state 154 non-null object 11 payment_method 154 non-null object 12 shipping_method 154 non-null object dtypes: float64(2), int64(1), object(10) memory usage: 15.8+ KB

👍 LiveDocs Tip:

Instead of just inspecting df.head(), push your DataFrame to a LiveDocs dashboard to visualize distributions, key metrics, or summary tables in real-time. This is especially useful when datasets are updated continuously.

2 Handling missing data

  • df.dropna()
  • df.fillna()


Missing values can break ML pipelines and skew LLM preprocessing.

These 2 commands handles missing data by either dropping rows or filling them with default values.

Cleaning data ensures your models learn from consistent, high quality inputs.


df_clean = df.dropna()

df_filled = df.fillna({"unit_price": 0, "score": 0.0})



🧩 LLM Use Case: Critical when embeddings or metadata columns have NaNs. Prevents downstream model failures.

3 Group by & aggregations


  • df.groupby


This command groups data by one or more columns and performs aggregations like mean, sum or count.

Aggregations are important, AI projects often require insights at different aggregation levels, for example average token length per user, model accuracy per prompt type etc.


result = df.groupby("product_category")["total_amount"].sum()


🧩 LLM Use Case: Group conversations by user, average embeddings by cluster, or compute metrics per dataset slice for bias/fairness checks.

product_category
Desktop PCs       22599.83
Graphics Cards    23149.78
Headphones         4069.78
Keyboards          2359.78
Laptops           21099.79
Mice               1439.74
Monitors          10789.77
Smartphones       15049.78
Storage            5249.71
Tablets            9929.74
Name: total_amount, dtype: float64

or applying aggregation with groupby

👍 LiveDocs Tip:

Push grouped data to a LiveDocs dashboard with interactive charts to monitor trends in real-time, making it easier for teams to spot anomalies or patterns.

4 Convert categorical variables into dummy/indicator variables


  • pd.get_dummies()


ML models require numeric inputs. One-hot encoding transforms categories like labels, roles or document types into a machine readable format.


Have a look at the example below:


df_encoded = pd.get_dummies(df, dtype=int)

In each unique category has been transformed into separate binary (True or False) column, which is now readable by ML models (remember ML models cannot interptret text like "blue", "yes", "people".

5 Apply a custom function to each row or column


This is useful to transform columns in ways build in functions don\'t support, for example lambda function.


Lambda function: Anonymous function that take any number of argument but evaluates and returns only one expression.


For example here I am going to split the name for product_name:


df[\'word_count\'] = df[\'product_name\'].apply(lambda x: len(str(x).split()))

and you will see the new word_count column in the end of the table, which counted the number of name in the product_name column

6 Convert to NumPy array or dictionaries


df.to_numpy()

This converts a Pandas DataFrame into a NumPy ndarray. The output is a multi-dimensional array where all elements are of a single common NumPy data type.

This is particularly useful for numerical computations and interoperability with libraries that primarily work with NumPy arrays.


numpy_df = df.to_numpy()

array([['HW001', '2024-01-03', 'Laptops', ..., 'NY', 'Credit Card',
        'Standard'],
       ['HW002', '2024-01-05', 'Smartphones', ..., 'CA', 'PayPal',
        'Express'],
       ['HW003', '2024-01-07', 'Tablets', ..., 'IL', 'Credit Card',
        'Standard'],
       ...,
       ['HW152', '2024-10-31', 'Smartphones', ..., 'CA', 'PayPal',
        'Standard'],
       ['HW153', '2024-11-02', 'Graphics Cards', ..., 'NC',
        'Credit Card', 'Express'],
       ['HW154', '2024-11-04', 'Tablets', ..., 'OR', 'Credit Card',
        'Standard']], shape=(154, 13), dtype=object)

df.to_dict(\'records\')


This is to convert a Pandas DataFrame into a list of dictionaries.

The output is a list where each element is a dictionary representing a row of the DataFrame.

[{'order_id': 'HW001',
  'date': '2024-01-03',
  'product_category': 'Laptops',
  'product_name': 'Gaming Laptop Pro X1',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1299.99,
  'total_amount': 1299.99,
  'customer_id': 'CUST001',
  'customer_city': 'New York',
  'customer_state': 'NY',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW002',
  'date': '2024-01-05',
  'product_category': 'Smartphones',
  'product_name': 'UltraPhone 15 Pro',
  'brand': 'MobileMax',
  'quantity': 2,
  'unit_price': 899.99,
  'total_amount': 1799.98,
  'customer_id': 'CUST002',
  'customer_city': 'Los Angeles',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Express'},
 {'order_id': 'HW003',
  'date': '2024-01-07',
  'product_category': 'Tablets',
  'product_name': 'TabletMax 12 inch',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST003',
  'customer_city': 'Chicago',
  'customer_state': 'IL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW004',
  'date': '2024-01-08',
  'product_category': 'Desktop PCs',
  'product_name': 'Workstation Elite 3000',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 2199.99,
  'total_amount': 2199.99,
  'customer_id': 'CUST004',
  'customer_city': 'Houston',
  'customer_state': 'TX',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW005',
  'date': '2024-01-10',
  'product_category': 'Graphics Cards',
  'product_name': 'RTX Gaming Card 4080',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1199.99,
  'total_amount': 1199.99,
  'customer_id': 'CUST005',
  'customer_city': 'Phoenix',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW006',
  'date': '2024-01-12',
  'product_category': 'Monitors',
  'product_name': '4K Ultra Monitor 32"',
  'brand': 'DisplayPro',
  'quantity': 2,
  'unit_price': 599.99,
  'total_amount': 1199.98,
  'customer_id': 'CUST006',
  'customer_city': 'Philadelphia',
  'customer_state': 'PA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW007',
  'date': '2024-01-15',
  'product_category': 'Keyboards',
  'product_name': 'Mechanical RGB Keyboard',
  'brand': 'PeriphTech',
  'quantity': 3,
  'unit_price': 129.99,
  'total_amount': 389.97,
  'customer_id': 'CUST007',
  'customer_city': 'San Antonio',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW008',
  'date': '2024-01-17',
  'product_category': 'Mice',
  'product_name': 'Wireless Gaming Mouse Pro',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 79.99,
  'total_amount': 79.99,
  'customer_id': 'CUST008',
  'customer_city': 'San Diego',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW009',
  'date': '2024-01-19',
  'product_category': 'Headphones',
  'product_name': 'Noise Cancel Pro 1000',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 299.99,
  'total_amount': 299.99,
  'customer_id': 'CUST009',
  'customer_city': 'Dallas',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW010',
  'date': '2024-01-21',
  'product_category': 'Storage',
  'product_name': 'SSD Drive 2TB NVMe',
  'brand': 'StorageTech',
  'quantity': 2,
  'unit_price': 199.99,
  'total_amount': 399.98,
  'customer_id': 'CUST010',
  'customer_city': 'San Jose',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW011',
  'date': '2024-01-23',
  'product_category': 'Laptops',
  'product_name': 'Business Laptop Ultra',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 899.99,
  'total_amount': 899.99,
  'customer_id': 'CUST011',
  'customer_city': 'Austin',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW012',
  'date': '2024-01-25',
  'product_category': 'Smartphones',
  'product_name': 'Budget Phone Smart 5G',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 399.99,
  'total_amount': 399.99,
  'customer_id': 'CUST012',
  'customer_city': 'Jacksonville',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW013',
  'date': '2024-01-27',
  'product_category': 'Graphics Cards',
  'product_name': 'Budget Gaming Card GTX',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST013',
  'customer_city': 'Fort Worth',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Express'},
 {'order_id': 'HW014',
  'date': '2024-01-29',
  'product_category': 'Tablets',
  'product_name': 'Mini Tablet 8 inch',
  'brand': 'TabCorp',
  'quantity': 2,
  'unit_price': 249.99,
  'total_amount': 499.98,
  'customer_id': 'CUST014',
  'customer_city': 'Columbus',
  'customer_state': 'OH',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW015',
  'date': '2024-01-31',
  'product_category': 'Desktop PCs',
  'product_name': 'Gaming PC Elite 5000',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 1899.99,
  'total_amount': 1899.99,
  'customer_id': 'CUST015',
  'customer_city': 'Charlotte',
  'customer_state': 'NC',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW016',
  'date': '2024-02-02',
  'product_category': 'Monitors',
  'product_name': 'Gaming Monitor 27" 144Hz',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST016',
  'customer_city': 'San Francisco',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW017',
  'date': '2024-02-04',
  'product_category': 'Keyboards',
  'product_name': 'Compact Wireless Keyboard',
  'brand': 'PeriphTech',
  'quantity': 2,
  'unit_price': 59.99,
  'total_amount': 119.98,
  'customer_id': 'CUST017',
  'customer_city': 'Indianapolis',
  'customer_state': 'IN',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW018',
  'date': '2024-02-06',
  'product_category': 'Mice',
  'product_name': 'Ergonomic Office Mouse',
  'brand': 'PeriphTech',
  'quantity': 4,
  'unit_price': 39.99,
  'total_amount': 159.96,
  'customer_id': 'CUST018',
  'customer_city': 'Seattle',
  'customer_state': 'WA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW019',
  'date': '2024-02-08',
  'product_category': 'Headphones',
  'product_name': 'Studio Monitor Headphones',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 199.99,
  'total_amount': 199.99,
  'customer_id': 'CUST019',
  'customer_city': 'Denver',
  'customer_state': 'CO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW020',
  'date': '2024-02-10',
  'product_category': 'Storage',
  'product_name': 'External HDD 4TB',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 129.99,
  'total_amount': 129.99,
  'customer_id': 'CUST020',
  'customer_city': 'Washington',
  'customer_state': 'DC',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW021',
  'date': '2024-02-12',
  'product_category': 'Laptops',
  'product_name': 'Ultrabook Pro 14',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1099.99,
  'total_amount': 1099.99,
  'customer_id': 'CUST021',
  'customer_city': 'Boston',
  'customer_state': 'MA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW022',
  'date': '2024-02-14',
  'product_category': 'Smartphones',
  'product_name': 'Flagship Phone Ultra Max',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 1199.99,
  'total_amount': 1199.99,
  'customer_id': 'CUST022',
  'customer_city': 'El Paso',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW023',
  'date': '2024-02-16',
  'product_category': 'Graphics Cards',
  'product_name': 'Professional Workstation GPU',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 2499.99,
  'total_amount': 2499.99,
  'customer_id': 'CUST023',
  'customer_city': 'Detroit',
  'customer_state': 'MI',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW024',
  'date': '2024-02-18',
  'product_category': 'Tablets',
  'product_name': 'Professional Tablet 13"',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 799.99,
  'total_amount': 799.99,
  'customer_id': 'CUST024',
  'customer_city': 'Nashville',
  'customer_state': 'TN',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW025',
  'date': '2024-02-20',
  'product_category': 'Desktop PCs',
  'product_name': 'Budget Desktop Starter',
  'brand': 'CompuBuild',
  'quantity': 2,
  'unit_price': 499.99,
  'total_amount': 999.98,
  'customer_id': 'CUST025',
  'customer_city': 'Portland',
  'customer_state': 'OR',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW026',
  'date': '2024-02-22',
  'product_category': 'Monitors',
  'product_name': 'Ultrawide Monitor 34"',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 899.99,
  'total_amount': 899.99,
  'customer_id': 'CUST026',
  'customer_city': 'Las Vegas',
  'customer_state': 'NV',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW027',
  'date': '2024-02-24',
  'product_category': 'Keyboards',
  'product_name': 'Gaming Mechanical Pro',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 179.99,
  'total_amount': 179.99,
  'customer_id': 'CUST027',
  'customer_city': 'Louisville',
  'customer_state': 'KY',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW028',
  'date': '2024-02-26',
  'product_category': 'Mice',
  'product_name': 'Precision CAD Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 99.99,
  'total_amount': 99.99,
  'customer_id': 'CUST028',
  'customer_city': 'Baltimore',
  'customer_state': 'MD',
  'payment_method': 'PayPal',
  'shipping_method': 'Express'},
 {'order_id': 'HW029',
  'date': '2024-02-28',
  'product_category': 'Headphones',
  'product_name': 'Wireless Earbuds Pro',
  'brand': 'AudioMax',
  'quantity': 3,
  'unit_price': 149.99,
  'total_amount': 449.97,
  'customer_id': 'CUST029',
  'customer_city': 'Milwaukee',
  'customer_state': 'WI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW030',
  'date': '2024-03-01',
  'product_category': 'Storage',
  'product_name': 'M.2 SSD 1TB Gaming',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 149.99,
  'total_amount': 149.99,
  'customer_id': 'CUST030',
  'customer_city': 'Albuquerque',
  'customer_state': 'NM',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW031',
  'date': '2024-03-03',
  'product_category': 'Laptops',
  'product_name': 'Creator Laptop 16"',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1599.99,
  'total_amount': 1599.99,
  'customer_id': 'CUST031',
  'customer_city': 'Tucson',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW032',
  'date': '2024-03-05',
  'product_category': 'Smartphones',
  'product_name': 'Mid-Range Phone Plus',
  'brand': 'MobileMax',
  'quantity': 2,
  'unit_price': 549.99,
  'total_amount': 1099.98,
  'customer_id': 'CUST032',
  'customer_city': 'Fresno',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW033',
  'date': '2024-03-07',
  'product_category': 'Graphics Cards',
  'product_name': 'Entry Gaming Card 3060',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 349.99,
  'total_amount': 349.99,
  'customer_id': 'CUST033',
  'customer_city': 'Sacramento',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW034',
  'date': '2024-03-09',
  'product_category': 'Tablets',
  'product_name': 'Budget Tablet Essential',
  'brand': 'TabCorp',
  'quantity': 3,
  'unit_price': 199.99,
  'total_amount': 599.97,
  'customer_id': 'CUST034',
  'customer_city': 'Long Beach',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW035',
  'date': '2024-03-11',
  'product_category': 'Desktop PCs',
  'product_name': 'Office Desktop Pro',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 799.99,
  'total_amount': 799.99,
  'customer_id': 'CUST035',
  'customer_city': 'Kansas City',
  'customer_state': 'MO',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW036',
  'date': '2024-03-13',
  'product_category': 'Monitors',
  'product_name': 'Business Monitor 24"',
  'brand': 'DisplayPro',
  'quantity': 4,
  'unit_price': 249.99,
  'total_amount': 999.96,
  'customer_id': 'CUST036',
  'customer_city': 'Mesa',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW037',
  'date': '2024-03-15',
  'product_category': 'Keyboards',
  'product_name': 'Slim Office Keyboard',
  'brand': 'PeriphTech',
  'quantity': 2,
  'unit_price': 49.99,
  'total_amount': 99.98,
  'customer_id': 'CUST037',
  'customer_city': 'Virginia Beach',
  'customer_state': 'VA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW038',
  'date': '2024-03-17',
  'product_category': 'Mice',
  'product_name': 'Travel Mouse Compact',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 29.99,
  'total_amount': 29.99,
  'customer_id': 'CUST038',
  'customer_city': 'Atlanta',
  'customer_state': 'GA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW039',
  'date': '2024-03-19',
  'product_category': 'Headphones',
  'product_name': 'Open-Back Studio HP',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 349.99,
  'total_amount': 349.99,
  'customer_id': 'CUST039',
  'customer_city': 'Colorado Springs',
  'customer_state': 'CO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW040',
  'date': '2024-03-21',
  'product_category': 'Storage',
  'product_name': 'Portable SSD 500GB',
  'brand': 'StorageTech',
  'quantity': 2,
  'unit_price': 89.99,
  'total_amount': 179.98,
  'customer_id': 'CUST040',
  'customer_city': 'Raleigh',
  'customer_state': 'NC',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW041',
  'date': '2024-03-23',
  'product_category': 'Laptops',
  'product_name': 'Student Laptop Basic',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 599.99,
  'total_amount': 599.99,
  'customer_id': 'CUST041',
  'customer_city': 'Omaha',
  'customer_state': 'NE',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW042',
  'date': '2024-03-25',
  'product_category': 'Smartphones',
  'product_name': 'Camera Phone Pro Max',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 1099.99,
  'total_amount': 1099.99,
  'customer_id': 'CUST042',
  'customer_city': 'Miami',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW043',
  'date': '2024-03-27',
  'product_category': 'Graphics Cards',
  'product_name': 'High-End Gaming RTX 4090',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1899.99,
  'total_amount': 1899.99,
  'customer_id': 'CUST043',
  'customer_city': 'Oakland',
  'customer_state': 'CA',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW044',
  'date': '2024-03-29',
  'product_category': 'Tablets',
  'product_name': 'Drawing Tablet Pro 15"',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 649.99,
  'total_amount': 649.99,
  'customer_id': 'CUST044',
  'customer_city': 'Minneapolis',
  'customer_state': 'MN',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW045',
  'date': '2024-03-31',
  'product_category': 'Desktop PCs',
  'product_name': 'Gaming Desktop Ultra',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 2799.99,
  'total_amount': 2799.99,
  'customer_id': 'CUST045',
  'customer_city': 'Tulsa',
  'customer_state': 'OK',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW046',
  'date': '2024-04-02',
  'product_category': 'Monitors',
  'product_name': 'Curved Gaming Monitor 27"',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 379.99,
  'total_amount': 379.99,
  'customer_id': 'CUST046',
  'customer_city': 'Cleveland',
  'customer_state': 'OH',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW047',
  'date': '2024-04-04',
  'product_category': 'Keyboards',
  'product_name': 'RGB Gaming Keyboard Pro',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 149.99,
  'total_amount': 149.99,
  'customer_id': 'CUST047',
  'customer_city': 'Wichita',
  'customer_state': 'KS',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW048',
  'date': '2024-04-06',
  'product_category': 'Mice',
  'product_name': 'Ambidextrous Gaming Mouse',
  'brand': 'PeriphTech',
  'quantity': 2,
  'unit_price': 69.99,
  'total_amount': 139.98,
  'customer_id': 'CUST048',
  'customer_city': 'Arlington',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW049',
  'date': '2024-04-08',
  'product_category': 'Headphones',
  'product_name': 'Gaming Headset RGB',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 129.99,
  'total_amount': 129.99,
  'customer_id': 'CUST049',
  'customer_city': 'New Orleans',
  'customer_state': 'LA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW050',
  'date': '2024-04-10',
  'product_category': 'Storage',
  'product_name': 'Gaming SSD 1TB RGB',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 179.99,
  'total_amount': 179.99,
  'customer_id': 'CUST050',
  'customer_city': 'Bakersfield',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW051',
  'date': '2024-04-12',
  'product_category': 'Laptops',
  'product_name': 'Convertible 2-in-1 Laptop',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 749.99,
  'total_amount': 749.99,
  'customer_id': 'CUST051',
  'customer_city': 'Tampa',
  'customer_state': 'FL',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW052',
  'date': '2024-04-14',
  'product_category': 'Smartphones',
  'product_name': 'Rugged Phone Outdoor',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 699.99,
  'total_amount': 699.99,
  'customer_id': 'CUST052',
  'customer_city': 'Honolulu',
  'customer_state': 'HI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW053',
  'date': '2024-04-16',
  'product_category': 'Graphics Cards',
  'product_name': 'Content Creator GPU',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 899.99,
  'total_amount': 899.99,
  'customer_id': 'CUST053',
  'customer_city': 'Anaheim',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW054',
  'date': '2024-04-18',
  'product_category': 'Tablets',
  'product_name': 'Kids Tablet Educational',
  'brand': 'TabCorp',
  'quantity': 2,
  'unit_price': 149.99,
  'total_amount': 299.98,
  'customer_id': 'CUST054',
  'customer_city': 'Santa Ana',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW055',
  'date': '2024-04-20',
  'product_category': 'Desktop PCs',
  'product_name': 'Mini PC Home Theater',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 399.99,
  'total_amount': 399.99,
  'customer_id': 'CUST055',
  'customer_city': 'St. Louis',
  'customer_state': 'MO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW056',
  'date': '2024-04-22',
  'product_category': 'Monitors',
  'product_name': 'Professional Color Monitor',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 1299.99,
  'total_amount': 1299.99,
  'customer_id': 'CUST056',
  'customer_city': 'Riverside',
  'customer_state': 'CA',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW057',
  'date': '2024-04-24',
  'product_category': 'Keyboards',
  'product_name': 'Wireless Ergonomic Split',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 189.99,
  'total_amount': 189.99,
  'customer_id': 'CUST057',
  'customer_city': 'Corpus Christi',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW058',
  'date': '2024-04-26',
  'product_category': 'Mice',
  'product_name': 'Vertical Ergonomic Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 49.99,
  'total_amount': 49.99,
  'customer_id': 'CUST058',
  'customer_city': 'Lexington',
  'customer_state': 'KY',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW059',
  'date': '2024-04-28',
  'product_category': 'Headphones',
  'product_name': 'Bone Conduction Sports',
  'brand': 'AudioMax',
  'quantity': 2,
  'unit_price': 99.99,
  'total_amount': 199.98,
  'customer_id': 'CUST059',
  'customer_city': 'Pittsburgh',
  'customer_state': 'PA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW060',
  'date': '2024-04-30',
  'product_category': 'Storage',
  'product_name': 'Network Attached Storage',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST060',
  'customer_city': 'Anchorage',
  'customer_state': 'AK',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW061',
  'date': '2024-05-02',
  'product_category': 'Laptops',
  'product_name': 'Lightweight Travel Laptop',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 799.99,
  'total_amount': 799.99,
  'customer_id': 'CUST061',
  'customer_city': 'Stockton',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW062',
  'date': '2024-05-04',
  'product_category': 'Smartphones',
  'product_name': 'Senior-Friendly Phone',
  'brand': 'MobileMax',
  'quantity': 3,
  'unit_price': 299.99,
  'total_amount': 899.97,
  'customer_id': 'CUST062',
  'customer_city': 'Cincinnati',
  'customer_state': 'OH',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW063',
  'date': '2024-05-06',
  'product_category': 'Graphics Cards',
  'product_name': 'Budget Workstation GPU',
  'brand': 'GraphiTech',
  'quantity': 2,
  'unit_price': 299.99,
  'total_amount': 599.98,
  'customer_id': 'CUST063',
  'customer_city': 'St. Paul',
  'customer_state': 'MN',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW064',
  'date': '2024-05-08',
  'product_category': 'Tablets',
  'product_name': 'E-Reader Tablet Ink',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 199.99,
  'total_amount': 199.99,
  'customer_id': 'CUST064',
  'customer_city': 'Toledo',
  'customer_state': 'OH',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW065',
  'date': '2024-05-10',
  'product_category': 'Desktop PCs',
  'product_name': 'All-in-One Desktop 24"',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 1199.99,
  'total_amount': 1199.99,
  'customer_id': 'CUST065',
  'customer_city': 'Newark',
  'customer_state': 'NJ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW066',
  'date': '2024-05-12',
  'product_category': 'Monitors',
  'product_name': 'Portable Monitor 15.6"',
  'brand': 'DisplayPro',
  'quantity': 2,
  'unit_price': 199.99,
  'total_amount': 399.98,
  'customer_id': 'CUST066',
  'customer_city': 'Greensboro',
  'customer_state': 'NC',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW067',
  'date': '2024-05-14',
  'product_category': 'Keyboards',
  'product_name': 'Backlit Gaming Keyboard',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 89.99,
  'total_amount': 89.99,
  'customer_id': 'CUST067',
  'customer_city': 'Plano',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW068',
  'date': '2024-05-16',
  'product_category': 'Mice',
  'product_name': 'Budget Optical Mouse',
  'brand': 'PeriphTech',
  'quantity': 5,
  'unit_price': 19.99,
  'total_amount': 99.95,
  'customer_id': 'CUST068',
  'customer_city': 'Henderson',
  'customer_state': 'NV',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW069',
  'date': '2024-05-18',
  'product_category': 'Headphones',
  'product_name': 'DJ Mixing Headphones',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 249.99,
  'total_amount': 249.99,
  'customer_id': 'CUST069',
  'customer_city': 'Lincoln',
  'customer_state': 'NE',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW070',
  'date': '2024-05-20',
  'product_category': 'Storage',
  'product_name': 'USB Flash Drive 128GB',
  'brand': 'StorageTech',
  'quantity': 10,
  'unit_price': 24.99,
  'total_amount': 249.9,
  'customer_id': 'CUST070',
  'customer_city': 'Buffalo',
  'customer_state': 'NY',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW071',
  'date': '2024-05-22',
  'product_category': 'Laptops',
  'product_name': 'Gaming Laptop Budget',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 899.99,
  'total_amount': 899.99,
  'customer_id': 'CUST071',
  'customer_city': 'Jersey City',
  'customer_state': 'NJ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW072',
  'date': '2024-05-24',
  'product_category': 'Smartphones',
  'product_name': 'Compact Phone Mini',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST072',
  'customer_city': 'Chula Vista',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW073',
  'date': '2024-05-26',
  'product_category': 'Graphics Cards',
  'product_name': 'Mining GPU Special',
  'brand': 'GraphiTech',
  'quantity': 3,
  'unit_price': 599.99,
  'total_amount': 1799.97,
  'customer_id': 'CUST073',
  'customer_city': 'Fort Wayne',
  'customer_state': 'IN',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW074',
  'date': '2024-05-28',
  'product_category': 'Tablets',
  'product_name': 'Waterproof Rugged Tablet',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 349.99,
  'total_amount': 349.99,
  'customer_id': 'CUST074',
  'customer_city': 'Orlando',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW075',
  'date': '2024-05-30',
  'product_category': 'Desktop PCs',
  'product_name': 'Silent Office Desktop',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 649.99,
  'total_amount': 649.99,
  'customer_id': 'CUST075',
  'customer_city': 'St. Petersburg',
  'customer_state': 'FL',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW076',
  'date': '2024-06-01',
  'product_category': 'Monitors',
  'product_name': 'Touchscreen Monitor 22"',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 399.99,
  'total_amount': 399.99,
  'customer_id': 'CUST076',
  'customer_city': 'Chandler',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW077',
  'date': '2024-06-03',
  'product_category': 'Keyboards',
  'product_name': 'Wireless Office Keyboard',
  'brand': 'PeriphTech',
  'quantity': 2,
  'unit_price': 69.99,
  'total_amount': 139.98,
  'customer_id': 'CUST077',
  'customer_city': 'Laredo',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW078',
  'date': '2024-06-05',
  'product_category': 'Mice',
  'product_name': 'Bluetooth Travel Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 34.99,
  'total_amount': 34.99,
  'customer_id': 'CUST078',
  'customer_city': 'Norfolk',
  'customer_state': 'VA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW079',
  'date': '2024-06-07',
  'product_category': 'Headphones',
  'product_name': 'Sports Wireless Earbuds',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 79.99,
  'total_amount': 79.99,
  'customer_id': 'CUST079',
  'customer_city': 'Durham',
  'customer_state': 'NC',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW080',
  'date': '2024-06-09',
  'product_category': 'Storage',
  'product_name': 'Micro SD Card 256GB',
  'brand': 'StorageTech',
  'quantity': 4,
  'unit_price': 39.99,
  'total_amount': 159.96,
  'customer_id': 'CUST080',
  'customer_city': 'Madison',
  'customer_state': 'WI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW081',
  'date': '2024-06-11',
  'product_category': 'Laptops',
  'product_name': 'Chromebook Education',
  'brand': 'TechForce',
  'quantity': 5,
  'unit_price': 349.99,
  'total_amount': 1749.95,
  'customer_id': 'CUST081',
  'customer_city': 'Lubbock',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW082',
  'date': '2024-06-13',
  'product_category': 'Smartphones',
  'product_name': '5G Phone Pro Business',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 749.99,
  'total_amount': 749.99,
  'customer_id': 'CUST082',
  'customer_city': 'Baton Rouge',
  'customer_state': 'LA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW083',
  'date': '2024-06-15',
  'product_category': 'Graphics Cards',
  'product_name': 'AI Workstation GPU',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 3499.99,
  'total_amount': 3499.99,
  'customer_id': 'CUST083',
  'customer_city': 'Reno',
  'customer_state': 'NV',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW084',
  'date': '2024-06-17',
  'product_category': 'Tablets',
  'product_name': 'Premium Tablet 12.9"',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 1099.99,
  'total_amount': 1099.99,
  'customer_id': 'CUST084',
  'customer_city': 'Hialeah',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW085',
  'date': '2024-06-19',
  'product_category': 'Desktop PCs',
  'product_name': 'Creator Workstation Pro',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 3299.99,
  'total_amount': 3299.99,
  'customer_id': 'CUST085',
  'customer_city': 'Chesapeake',
  'customer_state': 'VA',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW086',
  'date': '2024-06-21',
  'product_category': 'Monitors',
  'product_name': 'Dual Monitor Setup 24"',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 599.99,
  'total_amount': 599.99,
  'customer_id': 'CUST086',
  'customer_city': 'Garland',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW087',
  'date': '2024-06-23',
  'product_category': 'Keyboards',
  'product_name': 'Programmable Gaming KB',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 199.99,
  'total_amount': 199.99,
  'customer_id': 'CUST087',
  'customer_city': 'Scottsdale',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW088',
  'date': '2024-06-25',
  'product_category': 'Mice',
  'product_name': 'High-DPI Gaming Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 119.99,
  'total_amount': 119.99,
  'customer_id': 'CUST088',
  'customer_city': 'North Las Vegas',
  'customer_state': 'NV',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW089',
  'date': '2024-06-27',
  'product_category': 'Headphones',
  'product_name': 'True Wireless Premium',
  'brand': 'AudioMax',
  'quantity': 2,
  'unit_price': 199.99,
  'total_amount': 399.98,
  'customer_id': 'CUST089',
  'customer_city': 'Irving',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW090',
  'date': '2024-06-29',
  'product_category': 'Storage',
  'product_name': 'Enterprise SSD 4TB',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 899.99,
  'total_amount': 899.99,
  'customer_id': 'CUST090',
  'customer_city': 'Fremont',
  'customer_state': 'CA',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW091',
  'date': '2024-07-01',
  'product_category': 'Laptops',
  'product_name': 'Gaming Laptop RGB Elite',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1799.99,
  'total_amount': 1799.99,
  'customer_id': 'CUST091',
  'customer_city': 'Irvine',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW092',
  'date': '2024-07-03',
  'product_category': 'Smartphones',
  'product_name': 'Photography Phone Pro',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 949.99,
  'total_amount': 949.99,
  'customer_id': 'CUST092',
  'customer_city': 'Birmingham',
  'customer_state': 'AL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW093',
  'date': '2024-07-05',
  'product_category': 'Graphics Cards',
  'product_name': 'VR Gaming GPU Ultra',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1599.99,
  'total_amount': 1599.99,
  'customer_id': 'CUST093',
  'customer_city': 'Rochester',
  'customer_state': 'NY',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW094',
  'date': '2024-07-07',
  'product_category': 'Tablets',
  'product_name': 'Art Drawing Tablet Pro',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 549.99,
  'total_amount': 549.99,
  'customer_id': 'CUST094',
  'customer_city': 'San Bernardino',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW095',
  'date': '2024-07-09',
  'product_category': 'Desktop PCs',
  'product_name': 'Streaming PC Setup',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 1299.99,
  'total_amount': 1299.99,
  'customer_id': 'CUST095',
  'customer_city': 'Spokane',
  'customer_state': 'WA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW096',
  'date': '2024-07-11',
  'product_category': 'Monitors',
  'product_name': 'HDR Gaming Monitor 32"',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 799.99,
  'total_amount': 799.99,
  'customer_id': 'CUST096',
  'customer_city': 'Gilbert',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW097',
  'date': '2024-07-13',
  'product_category': 'Keyboards',
  'product_name': 'Clicky Mechanical Blue',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 109.99,
  'total_amount': 109.99,
  'customer_id': 'CUST097',
  'customer_city': 'Glendale',
  'customer_state': 'AZ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW098',
  'date': '2024-07-15',
  'product_category': 'Mice',
  'product_name': 'Lightweight Gaming Mouse',
  'brand': 'PeriphTech',
  'quantity': 2,
  'unit_price': 59.99,
  'total_amount': 119.98,
  'customer_id': 'CUST098',
  'customer_city': 'Akron',
  'customer_state': 'OH',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW099',
  'date': '2024-07-17',
  'product_category': 'Headphones',
  'product_name': 'Audiophile Open-Back',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 499.99,
  'total_amount': 499.99,
  'customer_id': 'CUST099',
  'customer_city': 'Little Rock',
  'customer_state': 'AR',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW100',
  'date': '2024-07-19',
  'product_category': 'Storage',
  'product_name': 'Gaming External SSD 2TB',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 249.99,
  'total_amount': 249.99,
  'customer_id': 'CUST100',
  'customer_city': 'Augusta',
  'customer_state': 'GA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW101',
  'date': '2024-07-21',
  'product_category': 'Laptops',
  'product_name': 'Budget Student Laptop',
  'brand': 'TechForce',
  'quantity': 2,
  'unit_price': 449.99,
  'total_amount': 899.98,
  'customer_id': 'CUST101',
  'customer_city': 'Columbus',
  'customer_state': 'GA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW102',
  'date': '2024-07-23',
  'product_category': 'Smartphones',
  'product_name': 'Foldable Phone Future',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 1799.99,
  'total_amount': 1799.99,
  'customer_id': 'CUST102',
  'customer_city': 'Grand Rapids',
  'customer_state': 'MI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW103',
  'date': '2024-07-25',
  'product_category': 'Graphics Cards',
  'product_name': 'Streaming GPU Encoder',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 749.99,
  'total_amount': 749.99,
  'customer_id': 'CUST103',
  'customer_city': 'Montgomery',
  'customer_state': 'AL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW104',
  'date': '2024-07-27',
  'product_category': 'Tablets',
  'product_name': 'Outdoor Rugged Tablet',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 429.99,
  'total_amount': 429.99,
  'customer_id': 'CUST104',
  'customer_city': 'Shreveport',
  'customer_state': 'LA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW105',
  'date': '2024-07-29',
  'product_category': 'Desktop PCs',
  'product_name': 'Compact Gaming PC',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 1099.99,
  'total_amount': 1099.99,
  'customer_id': 'CUST105',
  'customer_city': 'Mobile',
  'customer_state': 'AL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW106',
  'date': '2024-07-31',
  'product_category': 'Monitors',
  'product_name': 'Budget Monitor 21.5"',
  'brand': 'DisplayPro',
  'quantity': 3,
  'unit_price': 149.99,
  'total_amount': 449.97,
  'customer_id': 'CUST106',
  'customer_city': 'Des Moines',
  'customer_state': 'IA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW107',
  'date': '2024-08-02',
  'product_category': 'Keyboards',
  'product_name': 'Silent Mechanical KB',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 139.99,
  'total_amount': 139.99,
  'customer_id': 'CUST107',
  'customer_city': 'Grand Prairie',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW108',
  'date': '2024-08-04',
  'product_category': 'Mice',
  'product_name': 'Ambidextrous Office Mouse',
  'brand': 'PeriphTech',
  'quantity': 3,
  'unit_price': 44.99,
  'total_amount': 134.97,
  'customer_id': 'CUST108',
  'customer_city': 'Salt Lake City',
  'customer_state': 'UT',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW109',
  'date': '2024-08-06',
  'product_category': 'Headphones',
  'product_name': 'Kids Safe Volume HP',
  'brand': 'AudioMax',
  'quantity': 4,
  'unit_price': 59.99,
  'total_amount': 239.96,
  'customer_id': 'CUST109',
  'customer_city': 'Huntsville',
  'customer_state': 'AL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW110',
  'date': '2024-08-08',
  'product_category': 'Storage',
  'product_name': 'Cloud Storage Device',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 199.99,
  'total_amount': 199.99,
  'customer_id': 'CUST110',
  'customer_city': 'Tallahassee',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW111',
  'date': '2024-08-10',
  'product_category': 'Laptops',
  'product_name': 'Workstation Laptop 17"',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 2199.99,
  'total_amount': 2199.99,
  'customer_id': 'CUST111',
  'customer_city': 'Rockford',
  'customer_state': 'IL',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW112',
  'date': '2024-08-12',
  'product_category': 'Smartphones',
  'product_name': 'Elderly Phone Simple',
  'brand': 'MobileMax',
  'quantity': 2,
  'unit_price': 199.99,
  'total_amount': 399.98,
  'customer_id': 'CUST112',
  'customer_city': 'Tacoma',
  'customer_state': 'WA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW113',
  'date': '2024-08-14',
  'product_category': 'Graphics Cards',
  'product_name': 'Video Editing GPU Pro',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1299.99,
  'total_amount': 1299.99,
  'customer_id': 'CUST113',
  'customer_city': 'Dayton',
  'customer_state': 'OH',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW114',
  'date': '2024-08-16',
  'product_category': 'Tablets',
  'product_name': 'Business Tablet Security',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 699.99,
  'total_amount': 699.99,
  'customer_id': 'CUST114',
  'customer_city': 'Salinas',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW115',
  'date': '2024-08-18',
  'product_category': 'Desktop PCs',
  'product_name': 'Home Office Desktop',
  'brand': 'CompuBuild',
  'quantity': 2,
  'unit_price': 599.99,
  'total_amount': 1199.98,
  'customer_id': 'CUST115',
  'customer_city': 'Pomona',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW116',
  'date': '2024-08-20',
  'product_category': 'Monitors',
  'product_name': 'Multi-Monitor Setup 3x24',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 1199.99,
  'total_amount': 1199.99,
  'customer_id': 'CUST116',
  'customer_city': 'Paterson',
  'customer_state': 'NJ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW117',
  'date': '2024-08-22',
  'product_category': 'Keyboards',
  'product_name': 'Compact 60% Gaming KB',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 99.99,
  'total_amount': 99.99,
  'customer_id': 'CUST117',
  'customer_city': 'Overland Park',
  'customer_state': 'KS',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW118',
  'date': '2024-08-24',
  'product_category': 'Mice',
  'product_name': 'Wireless Presenter Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 79.99,
  'total_amount': 79.99,
  'customer_id': 'CUST118',
  'customer_city': 'Sioux Falls',
  'customer_state': 'SD',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW119',
  'date': '2024-08-26',
  'product_category': 'Headphones',
  'product_name': 'Fitness Waterproof HP',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 89.99,
  'total_amount': 89.99,
  'customer_id': 'CUST119',
  'customer_city': 'Springfield',
  'customer_state': 'MO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW120',
  'date': '2024-08-28',
  'product_category': 'Storage',
  'product_name': 'Backup Drive 8TB Desktop',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 199.99,
  'total_amount': 199.99,
  'customer_id': 'CUST120',
  'customer_city': 'Independence',
  'customer_state': 'MO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW121',
  'date': '2024-08-30',
  'product_category': 'Laptops',
  'product_name': 'Budget Gaming Laptop',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 999.99,
  'total_amount': 999.99,
  'customer_id': 'CUST121',
  'customer_city': 'Peoria',
  'customer_state': 'IL',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW122',
  'date': '2024-09-01',
  'product_category': 'Smartphones',
  'product_name': 'Gaming Phone RGB',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 849.99,
  'total_amount': 849.99,
  'customer_id': 'CUST122',
  'customer_city': 'Richmond',
  'customer_state': 'VA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW123',
  'date': '2024-09-03',
  'product_category': 'Graphics Cards',
  'product_name': 'Budget Entry GPU 1660',
  'brand': 'GraphiTech',
  'quantity': 2,
  'unit_price': 249.99,
  'total_amount': 499.98,
  'customer_id': 'CUST123',
  'customer_city': 'Cape Coral',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW124',
  'date': '2024-09-05',
  'product_category': 'Tablets',
  'product_name': 'Gaming Tablet Controller',
  'brand': 'TabCorp',
  'quantity': 1,
  'unit_price': 399.99,
  'total_amount': 399.99,
  'customer_id': 'CUST124',
  'customer_city': 'Springfield',
  'customer_state': 'IL',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW125',
  'date': '2024-09-07',
  'product_category': 'Desktop PCs',
  'product_name': 'Budget Family Desktop',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 449.99,
  'total_amount': 449.99,
  'customer_id': 'CUST125',
  'customer_city': 'Eugene',
  'customer_state': 'OR',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW126',
  'date': '2024-09-09',
  'product_category': 'Monitors',
  'product_name': 'Budget Gaming Monitor 24"',
  'brand': 'DisplayPro',
  'quantity': 2,
  'unit_price': 229.99,
  'total_amount': 459.98,
  'customer_id': 'CUST126',
  'customer_city': 'Santa Rosa',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW127',
  'date': '2024-09-11',
  'product_category': 'Keyboards',
  'product_name': 'Office Quiet Keyboard',
  'brand': 'PeriphTech',
  'quantity': 3,
  'unit_price': 39.99,
  'total_amount': 119.97,
  'customer_id': 'CUST127',
  'customer_city': 'Chattanooga',
  'customer_state': 'TN',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW128',
  'date': '2024-09-13',
  'product_category': 'Mice',
  'product_name': 'Gaming Mouse RGB Wired',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 49.99,
  'total_amount': 49.99,
  'customer_id': 'CUST128',
  'customer_city': 'Oceanside',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW129',
  'date': '2024-09-15',
  'product_category': 'Headphones',
  'product_name': 'Studio Reference HP',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 399.99,
  'total_amount': 399.99,
  'customer_id': 'CUST129',
  'customer_city': 'Garden Grove',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW130',
  'date': '2024-09-17',
  'product_category': 'Storage',
  'product_name': 'High-Speed USB-C SSD',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 149.99,
  'total_amount': 149.99,
  'customer_id': 'CUST130',
  'customer_city': 'Rancho Cucamonga',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW131',
  'date': '2024-09-19',
  'product_category': 'Laptops',
  'product_name': 'Creator Laptop OLED',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1899.99,
  'total_amount': 1899.99,
  'customer_id': 'CUST131',
  'customer_city': 'Port St. Lucie',
  'customer_state': 'FL',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW132',
  'date': '2024-09-21',
  'product_category': 'Smartphones',
  'product_name': 'Security Phone Encrypted',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 599.99,
  'total_amount': 599.99,
  'customer_id': 'CUST132',
  'customer_city': 'McKinney',
  'customer_state': 'TX',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW133',
  'date': '2024-09-23',
  'product_category': 'Graphics Cards',
  'product_name': 'Ray Tracing GPU Elite',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1099.99,
  'total_amount': 1099.99,
  'customer_id': 'CUST133',
  'customer_city': 'Sterling Heights',
  'customer_state': 'MI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW134',
  'date': '2024-09-25',
  'product_category': 'Tablets',
  'product_name': 'Medical Tablet Hygiene',
  'brand': 'TabCorp',
  'quantity': 2,
  'unit_price': 599.99,
  'total_amount': 1199.98,
  'customer_id': 'CUST134',
  'customer_city': 'Sioux City',
  'customer_state': 'IA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW135',
  'date': '2024-09-27',
  'product_category': 'Desktop PCs',
  'product_name': 'Server Desktop Rack',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 1799.99,
  'total_amount': 1799.99,
  'customer_id': 'CUST135',
  'customer_city': 'Coral Springs',
  'customer_state': 'FL',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW136',
  'date': '2024-09-29',
  'product_category': 'Monitors',
  'product_name': 'Designer Monitor 27" 4K',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 699.99,
  'total_amount': 699.99,
  'customer_id': 'CUST136',
  'customer_city': 'Elizabeth',
  'customer_state': 'NJ',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW137',
  'date': '2024-10-01',
  'product_category': 'Keyboards',
  'product_name': 'Retro Mechanical Typewriter',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 159.99,
  'total_amount': 159.99,
  'customer_id': 'CUST137',
  'customer_city': 'Concord',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW138',
  'date': '2024-10-03',
  'product_category': 'Mice',
  'product_name': 'Precision CAD Gaming Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 89.99,
  'total_amount': 89.99,
  'customer_id': 'CUST138',
  'customer_city': 'Topeka',
  'customer_state': 'KS',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW139',
  'date': '2024-10-05',
  'product_category': 'Headphones',
  'product_name': 'Podcast Recording HP',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 179.99,
  'total_amount': 179.99,
  'customer_id': 'CUST139',
  'customer_city': 'Thousand Oaks',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW140',
  'date': '2024-10-07',
  'product_category': 'Storage',
  'product_name': 'RAID Storage System 16TB',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 1299.99,
  'total_amount': 1299.99,
  'customer_id': 'CUST140',
  'customer_city': 'Simi Valley',
  'customer_state': 'CA',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW141',
  'date': '2024-10-09',
  'product_category': 'Laptops',
  'product_name': 'Ultralight Business Laptop',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 1399.99,
  'total_amount': 1399.99,
  'customer_id': 'CUST141',
  'customer_city': 'Denton',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW142',
  'date': '2024-10-11',
  'product_category': 'Smartphones',
  'product_name': 'Night Photography Phone',
  'brand': 'MobileMax',
  'quantity': 1,
  'unit_price': 1049.99,
  'total_amount': 1049.99,
  'customer_id': 'CUST142',
  'customer_city': 'Visalia',
  'customer_state': 'CA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW143',
  'date': '2024-10-13',
  'product_category': 'Graphics Cards',
  'product_name': 'Professional Render GPU',
  'brand': 'GraphiTech',
  'quantity': 1,
  'unit_price': 1999.99,
  'total_amount': 1999.99,
  'customer_id': 'CUST143',
  'customer_city': 'Thornton',
  'customer_state': 'CO',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Express'},
 {'order_id': 'HW144',
  'date': '2024-10-15',
  'product_category': 'Tablets',
  'product_name': 'Student Note-Taking Tablet',
  'brand': 'TabCorp',
  'quantity': 3,
  'unit_price': 299.99,
  'total_amount': 899.97,
  'customer_id': 'CUST144',
  'customer_city': 'Roseville',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW145',
  'date': '2024-10-17',
  'product_category': 'Desktop PCs',
  'product_name': 'Gaming PC RGB Ultimate',
  'brand': 'CompuBuild',
  'quantity': 1,
  'unit_price': 2499.99,
  'total_amount': 2499.99,
  'customer_id': 'CUST145',
  'customer_city': 'Olathe',
  'customer_state': 'KS',
  'payment_method': 'Bank Transfer',
  'shipping_method': 'Freight'},
 {'order_id': 'HW146',
  'date': '2024-10-19',
  'product_category': 'Monitors',
  'product_name': 'Esports Monitor 240Hz',
  'brand': 'DisplayPro',
  'quantity': 1,
  'unit_price': 549.99,
  'total_amount': 549.99,
  'customer_id': 'CUST146',
  'customer_city': 'Allentown',
  'customer_state': 'PA',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW147',
  'date': '2024-10-21',
  'product_category': 'Keyboards',
  'product_name': 'Gaming Keyboard Wireless',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 169.99,
  'total_amount': 169.99,
  'customer_id': 'CUST147',
  'customer_city': 'Beaumont',
  'customer_state': 'TX',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW148',
  'date': '2024-10-23',
  'product_category': 'Mice',
  'product_name': 'Customizable Gaming Mouse',
  'brand': 'PeriphTech',
  'quantity': 1,
  'unit_price': 149.99,
  'total_amount': 149.99,
  'customer_id': 'CUST148',
  'customer_city': 'Murfreesboro',
  'customer_state': 'TN',
  'payment_method': 'PayPal',
  'shipping_method': 'Express'},
 {'order_id': 'HW149',
  'date': '2024-10-25',
  'product_category': 'Headphones',
  'product_name': 'Home Theater Headphones',
  'brand': 'AudioMax',
  'quantity': 1,
  'unit_price': 299.99,
  'total_amount': 299.99,
  'customer_id': 'CUST149',
  'customer_city': 'Ann Arbor',
  'customer_state': 'MI',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW150',
  'date': '2024-10-27',
  'product_category': 'Storage',
  'product_name': 'Backup Solution Complete',
  'brand': 'StorageTech',
  'quantity': 1,
  'unit_price': 349.99,
  'total_amount': 349.99,
  'customer_id': 'CUST150',
  'customer_city': 'Westminster',
  'customer_state': 'CO',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'},
 {'order_id': 'HW151',
  'date': '2024-10-29',
  'product_category': 'Laptops',
  'product_name': 'Gaming Laptop RTX Elite',
  'brand': 'TechForce',
  'quantity': 1,
  'unit_price': 2199.99,
  'total_amount': 2199.99,
  'customer_id': 'CUST151',
  'customer_city': 'Evansville',
  'customer_state': 'IN',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW152',
  'date': '2024-10-31',
  'product_category': 'Smartphones',
  'product_name': 'Halloween Special Phone',
  'brand': 'MobileMax',
  'quantity': 2,
  'unit_price': 499.99,
  'total_amount': 999.98,
  'customer_id': 'CUST152',
  'customer_city': 'Orange',
  'customer_state': 'CA',
  'payment_method': 'PayPal',
  'shipping_method': 'Standard'},
 {'order_id': 'HW153',
  'date': '2024-11-02',
  'product_category': 'Graphics Cards',
  'product_name': 'Black Friday GPU Deal',
  'brand': 'GraphiTech',
  'quantity': 3,
  'unit_price': 899.99,
  'total_amount': 2699.97,
  'customer_id': 'CUST153',
  'customer_city': 'Cary',
  'customer_state': 'NC',
  'payment_method': 'Credit Card',
  'shipping_method': 'Express'},
 {'order_id': 'HW154',
  'date': '2024-11-04',
  'product_category': 'Tablets',
  'product_name': 'Black Friday Tablet Deal',
  'brand': 'TabCorp',
  'quantity': 4,
  'unit_price': 199.99,
  'total_amount': 799.96,
  'customer_id': 'CUST154',
  'customer_city': 'Salem',
  'customer_state': 'OR',
  'payment_method': 'Credit Card',
  'shipping_method': 'Standard'}]

👍 LiveDocs Tip:

Keep both raw and processed data in LiveDocs dashboards to track preprocessing results live, ensuring data consistency before training.

7 Expand Tokens, Embeddings or Lists


  • df.explode()


Here we are going to transform list-like entries in a DataFrame column into separate rows.


🧩 LLM Use Case: Splitting tokenized text into individual rows for embedding or analysis, or expand multiple LLM responses that return lists of results.


For example if your data column consists of list type data:


df_interests = pd.DataFrame({ "ID": [1, 2], "Interests": [["Full Stack", "Front End"], ["Machine Learning", "AI"]], "Tools": [["Javascript", "NodeJS"], ["Scikit-learn", \'TensorFlow\']] })

ID Interests Tools 0 1 Full Stack [Javascript, NodeJS] 0 1 Front End [Javascript, NodeJS] 1 2 Machine Learning [Scikit-learn, TensorFlow] 1 2 AI [Scikit-learn, TensorFlow] -------- ID Interests Tools 0 1 Full Stack Javascript 0 1 Front End NodeJS 1 2 Machine Learning Scikit-learn 1 2 AI TensorFlow

8 Quick Data Sampling


  • df.sample()


Often we will receive large datasets, but it is unnecessary to utilise the whole 10000 rows datasets if we are only going to, for example create mini batches work.


df.sample(5, random_state=42)


🧩 LLM Use Case: This is useful for picking random prompts for evaluation when you have a large dataset, or creating mini-batches for model fine-tuning.

9 Quick visualisation


  • df.plot()
  • df.hist()
  • df.boxplot()


Quick visualisation for distribution, trends and outliers directly from DataFrame.


Here we can visualise few things:

  1. Revenue trend over time
  2. Top 10 selling product by revenue
  3. Revenue by region
Output Image image/png - 2af8c0cb-2d5d-4eeb-8c86-343037248ed7
Output Image image/png - 2af8c0cb-2d5d-4eeb-8c86-343037248ed7
Output Image image/png - 2af8c0cb-2d5d-4eeb-8c86-343037248ed7

10 Reshaping Data


  • df.pivot_table()


This is to summarise and reshape data in pivot form.

This is a powerful method in Pandas used to create spreadsheet-style pivot tables.

It allows for the summarisation and aggregation of data, similar to pivot tables in Excel but with enhanced flexibility for data analysis.


pivot_df = df.pivot_table(index="product_category", values="total_amount", aggfunc=\'sum\')


🧩 LLM Use Case: This is useful to compare models across tasks (QA, summarization, coding), or ranking cost across different datasets.

11 Preparing Fine-Tuning Data


  • df.to_json


Example: df.to_json("finetune_hardware_data.jsonl", orient="records", lines=True)


Finally, after all the analysis, cleaning, modifying, pivoting, we can now exports our DataFrames into JSONL format for AI training.


🧩 LLM Use Case: This is useful to create fine-tuning datasets, or format structured inputs/outputs for supervised learning.