df.read_csv()
df.read_json()
df.read_parquet()
Every AI workflow stars with data ingestion. Large scale datasets for LLM fine-tuning, embeddings, or ML experiments often come in CSV, JSON, or Parquet formats.
Pandas provides simple functions to load them efficiently and inspect data quickly.
df = pd.read_csv(file_path)
df.head(5)
df.info()
Instead of just inspecting df.head()
, push your DataFrame to a LiveDocs dashboard to visualize distributions, key metrics, or summary tables in real-time. This is especially useful when datasets are updated continuously.
df.dropna()
df.fillna()
Missing values can break ML pipelines and skew LLM preprocessing.
These 2 commands handles missing data by either dropping rows or filling them with default values.
Cleaning data ensures your models learn from consistent, high quality inputs.
df_clean = df.dropna()
df_filled = df.fillna({"unit_price": 0, "score": 0.0})
🧩 LLM Use Case: Critical when embeddings or metadata columns have NaNs. Prevents downstream model failures.
df.groupby
This command groups data by one or more columns and performs aggregations like mean, sum or count.
Aggregations are important, AI projects often require insights at different aggregation levels, for example average token length per user, model accuracy per prompt type etc.
result = df.groupby("product_category")["total_amount"].sum()
🧩 LLM Use Case: Group conversations by user, average embeddings by cluster, or compute metrics per dataset slice for bias/fairness checks.
product_category Desktop PCs 22599.83 Graphics Cards 23149.78 Headphones 4069.78 Keyboards 2359.78 Laptops 21099.79 Mice 1439.74 Monitors 10789.77 Smartphones 15049.78 Storage 5249.71 Tablets 9929.74 Name: total_amount, dtype: float64
or applying aggregation with groupby
Push grouped data to a LiveDocs dashboard with interactive charts to monitor trends in real-time, making it easier for teams to spot anomalies or patterns.
pd.get_dummies()
ML models require numeric inputs. One-hot encoding transforms categories like labels, roles or document types into a machine readable format.
Have a look at the example below:
df_encoded = pd.get_dummies(df, dtype=int)
In each unique category has been transformed into separate binary (True or False) column, which is now readable by ML models (remember ML models cannot interptret text like "blue", "yes", "people".
This is useful to transform columns in ways build in functions don\'t support, for example lambda function.
Lambda function: Anonymous function that take any number of argument but evaluates and returns only one expression.
For example here I am going to split the name for product_name:
df[\'word_count\'] = df[\'product_name\'].apply(lambda x: len(str(x).split()))
and you will see the new word_count
column in the end of the table, which counted the number of name in the product_name
column
df.to_numpy()
This converts a Pandas DataFrame into a NumPy ndarray
. The output is a multi-dimensional array where all elements are of a single common NumPy data type.
This is particularly useful for numerical computations and interoperability with libraries that primarily work with NumPy arrays.
numpy_df = df.to_numpy()
array([['HW001', '2024-01-03', 'Laptops', ..., 'NY', 'Credit Card', 'Standard'], ['HW002', '2024-01-05', 'Smartphones', ..., 'CA', 'PayPal', 'Express'], ['HW003', '2024-01-07', 'Tablets', ..., 'IL', 'Credit Card', 'Standard'], ..., ['HW152', '2024-10-31', 'Smartphones', ..., 'CA', 'PayPal', 'Standard'], ['HW153', '2024-11-02', 'Graphics Cards', ..., 'NC', 'Credit Card', 'Express'], ['HW154', '2024-11-04', 'Tablets', ..., 'OR', 'Credit Card', 'Standard']], shape=(154, 13), dtype=object)
df.to_dict(\'records\')
This is to convert a Pandas DataFrame into a list of dictionaries.
The output is a list where each element is a dictionary representing a row of the DataFrame.
[{'order_id': 'HW001', 'date': '2024-01-03', 'product_category': 'Laptops', 'product_name': 'Gaming Laptop Pro X1', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1299.99, 'total_amount': 1299.99, 'customer_id': 'CUST001', 'customer_city': 'New York', 'customer_state': 'NY', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW002', 'date': '2024-01-05', 'product_category': 'Smartphones', 'product_name': 'UltraPhone 15 Pro', 'brand': 'MobileMax', 'quantity': 2, 'unit_price': 899.99, 'total_amount': 1799.98, 'customer_id': 'CUST002', 'customer_city': 'Los Angeles', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Express'}, {'order_id': 'HW003', 'date': '2024-01-07', 'product_category': 'Tablets', 'product_name': 'TabletMax 12 inch', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST003', 'customer_city': 'Chicago', 'customer_state': 'IL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW004', 'date': '2024-01-08', 'product_category': 'Desktop PCs', 'product_name': 'Workstation Elite 3000', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 2199.99, 'total_amount': 2199.99, 'customer_id': 'CUST004', 'customer_city': 'Houston', 'customer_state': 'TX', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW005', 'date': '2024-01-10', 'product_category': 'Graphics Cards', 'product_name': 'RTX Gaming Card 4080', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1199.99, 'total_amount': 1199.99, 'customer_id': 'CUST005', 'customer_city': 'Phoenix', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW006', 'date': '2024-01-12', 'product_category': 'Monitors', 'product_name': '4K Ultra Monitor 32"', 'brand': 'DisplayPro', 'quantity': 2, 'unit_price': 599.99, 'total_amount': 1199.98, 'customer_id': 'CUST006', 'customer_city': 'Philadelphia', 'customer_state': 'PA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW007', 'date': '2024-01-15', 'product_category': 'Keyboards', 'product_name': 'Mechanical RGB Keyboard', 'brand': 'PeriphTech', 'quantity': 3, 'unit_price': 129.99, 'total_amount': 389.97, 'customer_id': 'CUST007', 'customer_city': 'San Antonio', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW008', 'date': '2024-01-17', 'product_category': 'Mice', 'product_name': 'Wireless Gaming Mouse Pro', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 79.99, 'total_amount': 79.99, 'customer_id': 'CUST008', 'customer_city': 'San Diego', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW009', 'date': '2024-01-19', 'product_category': 'Headphones', 'product_name': 'Noise Cancel Pro 1000', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 299.99, 'total_amount': 299.99, 'customer_id': 'CUST009', 'customer_city': 'Dallas', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW010', 'date': '2024-01-21', 'product_category': 'Storage', 'product_name': 'SSD Drive 2TB NVMe', 'brand': 'StorageTech', 'quantity': 2, 'unit_price': 199.99, 'total_amount': 399.98, 'customer_id': 'CUST010', 'customer_city': 'San Jose', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW011', 'date': '2024-01-23', 'product_category': 'Laptops', 'product_name': 'Business Laptop Ultra', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 899.99, 'total_amount': 899.99, 'customer_id': 'CUST011', 'customer_city': 'Austin', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW012', 'date': '2024-01-25', 'product_category': 'Smartphones', 'product_name': 'Budget Phone Smart 5G', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 399.99, 'total_amount': 399.99, 'customer_id': 'CUST012', 'customer_city': 'Jacksonville', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW013', 'date': '2024-01-27', 'product_category': 'Graphics Cards', 'product_name': 'Budget Gaming Card GTX', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST013', 'customer_city': 'Fort Worth', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Express'}, {'order_id': 'HW014', 'date': '2024-01-29', 'product_category': 'Tablets', 'product_name': 'Mini Tablet 8 inch', 'brand': 'TabCorp', 'quantity': 2, 'unit_price': 249.99, 'total_amount': 499.98, 'customer_id': 'CUST014', 'customer_city': 'Columbus', 'customer_state': 'OH', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW015', 'date': '2024-01-31', 'product_category': 'Desktop PCs', 'product_name': 'Gaming PC Elite 5000', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 1899.99, 'total_amount': 1899.99, 'customer_id': 'CUST015', 'customer_city': 'Charlotte', 'customer_state': 'NC', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW016', 'date': '2024-02-02', 'product_category': 'Monitors', 'product_name': 'Gaming Monitor 27" 144Hz', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST016', 'customer_city': 'San Francisco', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW017', 'date': '2024-02-04', 'product_category': 'Keyboards', 'product_name': 'Compact Wireless Keyboard', 'brand': 'PeriphTech', 'quantity': 2, 'unit_price': 59.99, 'total_amount': 119.98, 'customer_id': 'CUST017', 'customer_city': 'Indianapolis', 'customer_state': 'IN', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW018', 'date': '2024-02-06', 'product_category': 'Mice', 'product_name': 'Ergonomic Office Mouse', 'brand': 'PeriphTech', 'quantity': 4, 'unit_price': 39.99, 'total_amount': 159.96, 'customer_id': 'CUST018', 'customer_city': 'Seattle', 'customer_state': 'WA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW019', 'date': '2024-02-08', 'product_category': 'Headphones', 'product_name': 'Studio Monitor Headphones', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 199.99, 'total_amount': 199.99, 'customer_id': 'CUST019', 'customer_city': 'Denver', 'customer_state': 'CO', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW020', 'date': '2024-02-10', 'product_category': 'Storage', 'product_name': 'External HDD 4TB', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 129.99, 'total_amount': 129.99, 'customer_id': 'CUST020', 'customer_city': 'Washington', 'customer_state': 'DC', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW021', 'date': '2024-02-12', 'product_category': 'Laptops', 'product_name': 'Ultrabook Pro 14', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1099.99, 'total_amount': 1099.99, 'customer_id': 'CUST021', 'customer_city': 'Boston', 'customer_state': 'MA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW022', 'date': '2024-02-14', 'product_category': 'Smartphones', 'product_name': 'Flagship Phone Ultra Max', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 1199.99, 'total_amount': 1199.99, 'customer_id': 'CUST022', 'customer_city': 'El Paso', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW023', 'date': '2024-02-16', 'product_category': 'Graphics Cards', 'product_name': 'Professional Workstation GPU', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 2499.99, 'total_amount': 2499.99, 'customer_id': 'CUST023', 'customer_city': 'Detroit', 'customer_state': 'MI', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW024', 'date': '2024-02-18', 'product_category': 'Tablets', 'product_name': 'Professional Tablet 13"', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 799.99, 'total_amount': 799.99, 'customer_id': 'CUST024', 'customer_city': 'Nashville', 'customer_state': 'TN', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW025', 'date': '2024-02-20', 'product_category': 'Desktop PCs', 'product_name': 'Budget Desktop Starter', 'brand': 'CompuBuild', 'quantity': 2, 'unit_price': 499.99, 'total_amount': 999.98, 'customer_id': 'CUST025', 'customer_city': 'Portland', 'customer_state': 'OR', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW026', 'date': '2024-02-22', 'product_category': 'Monitors', 'product_name': 'Ultrawide Monitor 34"', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 899.99, 'total_amount': 899.99, 'customer_id': 'CUST026', 'customer_city': 'Las Vegas', 'customer_state': 'NV', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW027', 'date': '2024-02-24', 'product_category': 'Keyboards', 'product_name': 'Gaming Mechanical Pro', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 179.99, 'total_amount': 179.99, 'customer_id': 'CUST027', 'customer_city': 'Louisville', 'customer_state': 'KY', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW028', 'date': '2024-02-26', 'product_category': 'Mice', 'product_name': 'Precision CAD Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 99.99, 'total_amount': 99.99, 'customer_id': 'CUST028', 'customer_city': 'Baltimore', 'customer_state': 'MD', 'payment_method': 'PayPal', 'shipping_method': 'Express'}, {'order_id': 'HW029', 'date': '2024-02-28', 'product_category': 'Headphones', 'product_name': 'Wireless Earbuds Pro', 'brand': 'AudioMax', 'quantity': 3, 'unit_price': 149.99, 'total_amount': 449.97, 'customer_id': 'CUST029', 'customer_city': 'Milwaukee', 'customer_state': 'WI', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW030', 'date': '2024-03-01', 'product_category': 'Storage', 'product_name': 'M.2 SSD 1TB Gaming', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 149.99, 'total_amount': 149.99, 'customer_id': 'CUST030', 'customer_city': 'Albuquerque', 'customer_state': 'NM', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW031', 'date': '2024-03-03', 'product_category': 'Laptops', 'product_name': 'Creator Laptop 16"', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1599.99, 'total_amount': 1599.99, 'customer_id': 'CUST031', 'customer_city': 'Tucson', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW032', 'date': '2024-03-05', 'product_category': 'Smartphones', 'product_name': 'Mid-Range Phone Plus', 'brand': 'MobileMax', 'quantity': 2, 'unit_price': 549.99, 'total_amount': 1099.98, 'customer_id': 'CUST032', 'customer_city': 'Fresno', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW033', 'date': '2024-03-07', 'product_category': 'Graphics Cards', 'product_name': 'Entry Gaming Card 3060', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 349.99, 'total_amount': 349.99, 'customer_id': 'CUST033', 'customer_city': 'Sacramento', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW034', 'date': '2024-03-09', 'product_category': 'Tablets', 'product_name': 'Budget Tablet Essential', 'brand': 'TabCorp', 'quantity': 3, 'unit_price': 199.99, 'total_amount': 599.97, 'customer_id': 'CUST034', 'customer_city': 'Long Beach', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW035', 'date': '2024-03-11', 'product_category': 'Desktop PCs', 'product_name': 'Office Desktop Pro', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 799.99, 'total_amount': 799.99, 'customer_id': 'CUST035', 'customer_city': 'Kansas City', 'customer_state': 'MO', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW036', 'date': '2024-03-13', 'product_category': 'Monitors', 'product_name': 'Business Monitor 24"', 'brand': 'DisplayPro', 'quantity': 4, 'unit_price': 249.99, 'total_amount': 999.96, 'customer_id': 'CUST036', 'customer_city': 'Mesa', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW037', 'date': '2024-03-15', 'product_category': 'Keyboards', 'product_name': 'Slim Office Keyboard', 'brand': 'PeriphTech', 'quantity': 2, 'unit_price': 49.99, 'total_amount': 99.98, 'customer_id': 'CUST037', 'customer_city': 'Virginia Beach', 'customer_state': 'VA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW038', 'date': '2024-03-17', 'product_category': 'Mice', 'product_name': 'Travel Mouse Compact', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 29.99, 'total_amount': 29.99, 'customer_id': 'CUST038', 'customer_city': 'Atlanta', 'customer_state': 'GA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW039', 'date': '2024-03-19', 'product_category': 'Headphones', 'product_name': 'Open-Back Studio HP', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 349.99, 'total_amount': 349.99, 'customer_id': 'CUST039', 'customer_city': 'Colorado Springs', 'customer_state': 'CO', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW040', 'date': '2024-03-21', 'product_category': 'Storage', 'product_name': 'Portable SSD 500GB', 'brand': 'StorageTech', 'quantity': 2, 'unit_price': 89.99, 'total_amount': 179.98, 'customer_id': 'CUST040', 'customer_city': 'Raleigh', 'customer_state': 'NC', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW041', 'date': '2024-03-23', 'product_category': 'Laptops', 'product_name': 'Student Laptop Basic', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 599.99, 'total_amount': 599.99, 'customer_id': 'CUST041', 'customer_city': 'Omaha', 'customer_state': 'NE', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW042', 'date': '2024-03-25', 'product_category': 'Smartphones', 'product_name': 'Camera Phone Pro Max', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 1099.99, 'total_amount': 1099.99, 'customer_id': 'CUST042', 'customer_city': 'Miami', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW043', 'date': '2024-03-27', 'product_category': 'Graphics Cards', 'product_name': 'High-End Gaming RTX 4090', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1899.99, 'total_amount': 1899.99, 'customer_id': 'CUST043', 'customer_city': 'Oakland', 'customer_state': 'CA', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW044', 'date': '2024-03-29', 'product_category': 'Tablets', 'product_name': 'Drawing Tablet Pro 15"', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 649.99, 'total_amount': 649.99, 'customer_id': 'CUST044', 'customer_city': 'Minneapolis', 'customer_state': 'MN', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW045', 'date': '2024-03-31', 'product_category': 'Desktop PCs', 'product_name': 'Gaming Desktop Ultra', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 2799.99, 'total_amount': 2799.99, 'customer_id': 'CUST045', 'customer_city': 'Tulsa', 'customer_state': 'OK', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW046', 'date': '2024-04-02', 'product_category': 'Monitors', 'product_name': 'Curved Gaming Monitor 27"', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 379.99, 'total_amount': 379.99, 'customer_id': 'CUST046', 'customer_city': 'Cleveland', 'customer_state': 'OH', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW047', 'date': '2024-04-04', 'product_category': 'Keyboards', 'product_name': 'RGB Gaming Keyboard Pro', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 149.99, 'total_amount': 149.99, 'customer_id': 'CUST047', 'customer_city': 'Wichita', 'customer_state': 'KS', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW048', 'date': '2024-04-06', 'product_category': 'Mice', 'product_name': 'Ambidextrous Gaming Mouse', 'brand': 'PeriphTech', 'quantity': 2, 'unit_price': 69.99, 'total_amount': 139.98, 'customer_id': 'CUST048', 'customer_city': 'Arlington', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW049', 'date': '2024-04-08', 'product_category': 'Headphones', 'product_name': 'Gaming Headset RGB', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 129.99, 'total_amount': 129.99, 'customer_id': 'CUST049', 'customer_city': 'New Orleans', 'customer_state': 'LA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW050', 'date': '2024-04-10', 'product_category': 'Storage', 'product_name': 'Gaming SSD 1TB RGB', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 179.99, 'total_amount': 179.99, 'customer_id': 'CUST050', 'customer_city': 'Bakersfield', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW051', 'date': '2024-04-12', 'product_category': 'Laptops', 'product_name': 'Convertible 2-in-1 Laptop', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 749.99, 'total_amount': 749.99, 'customer_id': 'CUST051', 'customer_city': 'Tampa', 'customer_state': 'FL', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW052', 'date': '2024-04-14', 'product_category': 'Smartphones', 'product_name': 'Rugged Phone Outdoor', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 699.99, 'total_amount': 699.99, 'customer_id': 'CUST052', 'customer_city': 'Honolulu', 'customer_state': 'HI', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW053', 'date': '2024-04-16', 'product_category': 'Graphics Cards', 'product_name': 'Content Creator GPU', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 899.99, 'total_amount': 899.99, 'customer_id': 'CUST053', 'customer_city': 'Anaheim', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW054', 'date': '2024-04-18', 'product_category': 'Tablets', 'product_name': 'Kids Tablet Educational', 'brand': 'TabCorp', 'quantity': 2, 'unit_price': 149.99, 'total_amount': 299.98, 'customer_id': 'CUST054', 'customer_city': 'Santa Ana', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW055', 'date': '2024-04-20', 'product_category': 'Desktop PCs', 'product_name': 'Mini PC Home Theater', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 399.99, 'total_amount': 399.99, 'customer_id': 'CUST055', 'customer_city': 'St. Louis', 'customer_state': 'MO', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW056', 'date': '2024-04-22', 'product_category': 'Monitors', 'product_name': 'Professional Color Monitor', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 1299.99, 'total_amount': 1299.99, 'customer_id': 'CUST056', 'customer_city': 'Riverside', 'customer_state': 'CA', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW057', 'date': '2024-04-24', 'product_category': 'Keyboards', 'product_name': 'Wireless Ergonomic Split', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 189.99, 'total_amount': 189.99, 'customer_id': 'CUST057', 'customer_city': 'Corpus Christi', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW058', 'date': '2024-04-26', 'product_category': 'Mice', 'product_name': 'Vertical Ergonomic Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 49.99, 'total_amount': 49.99, 'customer_id': 'CUST058', 'customer_city': 'Lexington', 'customer_state': 'KY', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW059', 'date': '2024-04-28', 'product_category': 'Headphones', 'product_name': 'Bone Conduction Sports', 'brand': 'AudioMax', 'quantity': 2, 'unit_price': 99.99, 'total_amount': 199.98, 'customer_id': 'CUST059', 'customer_city': 'Pittsburgh', 'customer_state': 'PA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW060', 'date': '2024-04-30', 'product_category': 'Storage', 'product_name': 'Network Attached Storage', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST060', 'customer_city': 'Anchorage', 'customer_state': 'AK', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW061', 'date': '2024-05-02', 'product_category': 'Laptops', 'product_name': 'Lightweight Travel Laptop', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 799.99, 'total_amount': 799.99, 'customer_id': 'CUST061', 'customer_city': 'Stockton', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW062', 'date': '2024-05-04', 'product_category': 'Smartphones', 'product_name': 'Senior-Friendly Phone', 'brand': 'MobileMax', 'quantity': 3, 'unit_price': 299.99, 'total_amount': 899.97, 'customer_id': 'CUST062', 'customer_city': 'Cincinnati', 'customer_state': 'OH', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW063', 'date': '2024-05-06', 'product_category': 'Graphics Cards', 'product_name': 'Budget Workstation GPU', 'brand': 'GraphiTech', 'quantity': 2, 'unit_price': 299.99, 'total_amount': 599.98, 'customer_id': 'CUST063', 'customer_city': 'St. Paul', 'customer_state': 'MN', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW064', 'date': '2024-05-08', 'product_category': 'Tablets', 'product_name': 'E-Reader Tablet Ink', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 199.99, 'total_amount': 199.99, 'customer_id': 'CUST064', 'customer_city': 'Toledo', 'customer_state': 'OH', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW065', 'date': '2024-05-10', 'product_category': 'Desktop PCs', 'product_name': 'All-in-One Desktop 24"', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 1199.99, 'total_amount': 1199.99, 'customer_id': 'CUST065', 'customer_city': 'Newark', 'customer_state': 'NJ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW066', 'date': '2024-05-12', 'product_category': 'Monitors', 'product_name': 'Portable Monitor 15.6"', 'brand': 'DisplayPro', 'quantity': 2, 'unit_price': 199.99, 'total_amount': 399.98, 'customer_id': 'CUST066', 'customer_city': 'Greensboro', 'customer_state': 'NC', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW067', 'date': '2024-05-14', 'product_category': 'Keyboards', 'product_name': 'Backlit Gaming Keyboard', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 89.99, 'total_amount': 89.99, 'customer_id': 'CUST067', 'customer_city': 'Plano', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW068', 'date': '2024-05-16', 'product_category': 'Mice', 'product_name': 'Budget Optical Mouse', 'brand': 'PeriphTech', 'quantity': 5, 'unit_price': 19.99, 'total_amount': 99.95, 'customer_id': 'CUST068', 'customer_city': 'Henderson', 'customer_state': 'NV', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW069', 'date': '2024-05-18', 'product_category': 'Headphones', 'product_name': 'DJ Mixing Headphones', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 249.99, 'total_amount': 249.99, 'customer_id': 'CUST069', 'customer_city': 'Lincoln', 'customer_state': 'NE', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW070', 'date': '2024-05-20', 'product_category': 'Storage', 'product_name': 'USB Flash Drive 128GB', 'brand': 'StorageTech', 'quantity': 10, 'unit_price': 24.99, 'total_amount': 249.9, 'customer_id': 'CUST070', 'customer_city': 'Buffalo', 'customer_state': 'NY', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW071', 'date': '2024-05-22', 'product_category': 'Laptops', 'product_name': 'Gaming Laptop Budget', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 899.99, 'total_amount': 899.99, 'customer_id': 'CUST071', 'customer_city': 'Jersey City', 'customer_state': 'NJ', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW072', 'date': '2024-05-24', 'product_category': 'Smartphones', 'product_name': 'Compact Phone Mini', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST072', 'customer_city': 'Chula Vista', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW073', 'date': '2024-05-26', 'product_category': 'Graphics Cards', 'product_name': 'Mining GPU Special', 'brand': 'GraphiTech', 'quantity': 3, 'unit_price': 599.99, 'total_amount': 1799.97, 'customer_id': 'CUST073', 'customer_city': 'Fort Wayne', 'customer_state': 'IN', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW074', 'date': '2024-05-28', 'product_category': 'Tablets', 'product_name': 'Waterproof Rugged Tablet', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 349.99, 'total_amount': 349.99, 'customer_id': 'CUST074', 'customer_city': 'Orlando', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW075', 'date': '2024-05-30', 'product_category': 'Desktop PCs', 'product_name': 'Silent Office Desktop', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 649.99, 'total_amount': 649.99, 'customer_id': 'CUST075', 'customer_city': 'St. Petersburg', 'customer_state': 'FL', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW076', 'date': '2024-06-01', 'product_category': 'Monitors', 'product_name': 'Touchscreen Monitor 22"', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 399.99, 'total_amount': 399.99, 'customer_id': 'CUST076', 'customer_city': 'Chandler', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW077', 'date': '2024-06-03', 'product_category': 'Keyboards', 'product_name': 'Wireless Office Keyboard', 'brand': 'PeriphTech', 'quantity': 2, 'unit_price': 69.99, 'total_amount': 139.98, 'customer_id': 'CUST077', 'customer_city': 'Laredo', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW078', 'date': '2024-06-05', 'product_category': 'Mice', 'product_name': 'Bluetooth Travel Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 34.99, 'total_amount': 34.99, 'customer_id': 'CUST078', 'customer_city': 'Norfolk', 'customer_state': 'VA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW079', 'date': '2024-06-07', 'product_category': 'Headphones', 'product_name': 'Sports Wireless Earbuds', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 79.99, 'total_amount': 79.99, 'customer_id': 'CUST079', 'customer_city': 'Durham', 'customer_state': 'NC', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW080', 'date': '2024-06-09', 'product_category': 'Storage', 'product_name': 'Micro SD Card 256GB', 'brand': 'StorageTech', 'quantity': 4, 'unit_price': 39.99, 'total_amount': 159.96, 'customer_id': 'CUST080', 'customer_city': 'Madison', 'customer_state': 'WI', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW081', 'date': '2024-06-11', 'product_category': 'Laptops', 'product_name': 'Chromebook Education', 'brand': 'TechForce', 'quantity': 5, 'unit_price': 349.99, 'total_amount': 1749.95, 'customer_id': 'CUST081', 'customer_city': 'Lubbock', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW082', 'date': '2024-06-13', 'product_category': 'Smartphones', 'product_name': '5G Phone Pro Business', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 749.99, 'total_amount': 749.99, 'customer_id': 'CUST082', 'customer_city': 'Baton Rouge', 'customer_state': 'LA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW083', 'date': '2024-06-15', 'product_category': 'Graphics Cards', 'product_name': 'AI Workstation GPU', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 3499.99, 'total_amount': 3499.99, 'customer_id': 'CUST083', 'customer_city': 'Reno', 'customer_state': 'NV', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW084', 'date': '2024-06-17', 'product_category': 'Tablets', 'product_name': 'Premium Tablet 12.9"', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 1099.99, 'total_amount': 1099.99, 'customer_id': 'CUST084', 'customer_city': 'Hialeah', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW085', 'date': '2024-06-19', 'product_category': 'Desktop PCs', 'product_name': 'Creator Workstation Pro', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 3299.99, 'total_amount': 3299.99, 'customer_id': 'CUST085', 'customer_city': 'Chesapeake', 'customer_state': 'VA', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW086', 'date': '2024-06-21', 'product_category': 'Monitors', 'product_name': 'Dual Monitor Setup 24"', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 599.99, 'total_amount': 599.99, 'customer_id': 'CUST086', 'customer_city': 'Garland', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW087', 'date': '2024-06-23', 'product_category': 'Keyboards', 'product_name': 'Programmable Gaming KB', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 199.99, 'total_amount': 199.99, 'customer_id': 'CUST087', 'customer_city': 'Scottsdale', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW088', 'date': '2024-06-25', 'product_category': 'Mice', 'product_name': 'High-DPI Gaming Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 119.99, 'total_amount': 119.99, 'customer_id': 'CUST088', 'customer_city': 'North Las Vegas', 'customer_state': 'NV', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW089', 'date': '2024-06-27', 'product_category': 'Headphones', 'product_name': 'True Wireless Premium', 'brand': 'AudioMax', 'quantity': 2, 'unit_price': 199.99, 'total_amount': 399.98, 'customer_id': 'CUST089', 'customer_city': 'Irving', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW090', 'date': '2024-06-29', 'product_category': 'Storage', 'product_name': 'Enterprise SSD 4TB', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 899.99, 'total_amount': 899.99, 'customer_id': 'CUST090', 'customer_city': 'Fremont', 'customer_state': 'CA', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW091', 'date': '2024-07-01', 'product_category': 'Laptops', 'product_name': 'Gaming Laptop RGB Elite', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1799.99, 'total_amount': 1799.99, 'customer_id': 'CUST091', 'customer_city': 'Irvine', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW092', 'date': '2024-07-03', 'product_category': 'Smartphones', 'product_name': 'Photography Phone Pro', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 949.99, 'total_amount': 949.99, 'customer_id': 'CUST092', 'customer_city': 'Birmingham', 'customer_state': 'AL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW093', 'date': '2024-07-05', 'product_category': 'Graphics Cards', 'product_name': 'VR Gaming GPU Ultra', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1599.99, 'total_amount': 1599.99, 'customer_id': 'CUST093', 'customer_city': 'Rochester', 'customer_state': 'NY', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW094', 'date': '2024-07-07', 'product_category': 'Tablets', 'product_name': 'Art Drawing Tablet Pro', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 549.99, 'total_amount': 549.99, 'customer_id': 'CUST094', 'customer_city': 'San Bernardino', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW095', 'date': '2024-07-09', 'product_category': 'Desktop PCs', 'product_name': 'Streaming PC Setup', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 1299.99, 'total_amount': 1299.99, 'customer_id': 'CUST095', 'customer_city': 'Spokane', 'customer_state': 'WA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW096', 'date': '2024-07-11', 'product_category': 'Monitors', 'product_name': 'HDR Gaming Monitor 32"', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 799.99, 'total_amount': 799.99, 'customer_id': 'CUST096', 'customer_city': 'Gilbert', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW097', 'date': '2024-07-13', 'product_category': 'Keyboards', 'product_name': 'Clicky Mechanical Blue', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 109.99, 'total_amount': 109.99, 'customer_id': 'CUST097', 'customer_city': 'Glendale', 'customer_state': 'AZ', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW098', 'date': '2024-07-15', 'product_category': 'Mice', 'product_name': 'Lightweight Gaming Mouse', 'brand': 'PeriphTech', 'quantity': 2, 'unit_price': 59.99, 'total_amount': 119.98, 'customer_id': 'CUST098', 'customer_city': 'Akron', 'customer_state': 'OH', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW099', 'date': '2024-07-17', 'product_category': 'Headphones', 'product_name': 'Audiophile Open-Back', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 499.99, 'total_amount': 499.99, 'customer_id': 'CUST099', 'customer_city': 'Little Rock', 'customer_state': 'AR', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW100', 'date': '2024-07-19', 'product_category': 'Storage', 'product_name': 'Gaming External SSD 2TB', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 249.99, 'total_amount': 249.99, 'customer_id': 'CUST100', 'customer_city': 'Augusta', 'customer_state': 'GA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW101', 'date': '2024-07-21', 'product_category': 'Laptops', 'product_name': 'Budget Student Laptop', 'brand': 'TechForce', 'quantity': 2, 'unit_price': 449.99, 'total_amount': 899.98, 'customer_id': 'CUST101', 'customer_city': 'Columbus', 'customer_state': 'GA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW102', 'date': '2024-07-23', 'product_category': 'Smartphones', 'product_name': 'Foldable Phone Future', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 1799.99, 'total_amount': 1799.99, 'customer_id': 'CUST102', 'customer_city': 'Grand Rapids', 'customer_state': 'MI', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW103', 'date': '2024-07-25', 'product_category': 'Graphics Cards', 'product_name': 'Streaming GPU Encoder', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 749.99, 'total_amount': 749.99, 'customer_id': 'CUST103', 'customer_city': 'Montgomery', 'customer_state': 'AL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW104', 'date': '2024-07-27', 'product_category': 'Tablets', 'product_name': 'Outdoor Rugged Tablet', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 429.99, 'total_amount': 429.99, 'customer_id': 'CUST104', 'customer_city': 'Shreveport', 'customer_state': 'LA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW105', 'date': '2024-07-29', 'product_category': 'Desktop PCs', 'product_name': 'Compact Gaming PC', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 1099.99, 'total_amount': 1099.99, 'customer_id': 'CUST105', 'customer_city': 'Mobile', 'customer_state': 'AL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW106', 'date': '2024-07-31', 'product_category': 'Monitors', 'product_name': 'Budget Monitor 21.5"', 'brand': 'DisplayPro', 'quantity': 3, 'unit_price': 149.99, 'total_amount': 449.97, 'customer_id': 'CUST106', 'customer_city': 'Des Moines', 'customer_state': 'IA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW107', 'date': '2024-08-02', 'product_category': 'Keyboards', 'product_name': 'Silent Mechanical KB', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 139.99, 'total_amount': 139.99, 'customer_id': 'CUST107', 'customer_city': 'Grand Prairie', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW108', 'date': '2024-08-04', 'product_category': 'Mice', 'product_name': 'Ambidextrous Office Mouse', 'brand': 'PeriphTech', 'quantity': 3, 'unit_price': 44.99, 'total_amount': 134.97, 'customer_id': 'CUST108', 'customer_city': 'Salt Lake City', 'customer_state': 'UT', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW109', 'date': '2024-08-06', 'product_category': 'Headphones', 'product_name': 'Kids Safe Volume HP', 'brand': 'AudioMax', 'quantity': 4, 'unit_price': 59.99, 'total_amount': 239.96, 'customer_id': 'CUST109', 'customer_city': 'Huntsville', 'customer_state': 'AL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW110', 'date': '2024-08-08', 'product_category': 'Storage', 'product_name': 'Cloud Storage Device', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 199.99, 'total_amount': 199.99, 'customer_id': 'CUST110', 'customer_city': 'Tallahassee', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW111', 'date': '2024-08-10', 'product_category': 'Laptops', 'product_name': 'Workstation Laptop 17"', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 2199.99, 'total_amount': 2199.99, 'customer_id': 'CUST111', 'customer_city': 'Rockford', 'customer_state': 'IL', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW112', 'date': '2024-08-12', 'product_category': 'Smartphones', 'product_name': 'Elderly Phone Simple', 'brand': 'MobileMax', 'quantity': 2, 'unit_price': 199.99, 'total_amount': 399.98, 'customer_id': 'CUST112', 'customer_city': 'Tacoma', 'customer_state': 'WA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW113', 'date': '2024-08-14', 'product_category': 'Graphics Cards', 'product_name': 'Video Editing GPU Pro', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1299.99, 'total_amount': 1299.99, 'customer_id': 'CUST113', 'customer_city': 'Dayton', 'customer_state': 'OH', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW114', 'date': '2024-08-16', 'product_category': 'Tablets', 'product_name': 'Business Tablet Security', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 699.99, 'total_amount': 699.99, 'customer_id': 'CUST114', 'customer_city': 'Salinas', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW115', 'date': '2024-08-18', 'product_category': 'Desktop PCs', 'product_name': 'Home Office Desktop', 'brand': 'CompuBuild', 'quantity': 2, 'unit_price': 599.99, 'total_amount': 1199.98, 'customer_id': 'CUST115', 'customer_city': 'Pomona', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW116', 'date': '2024-08-20', 'product_category': 'Monitors', 'product_name': 'Multi-Monitor Setup 3x24', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 1199.99, 'total_amount': 1199.99, 'customer_id': 'CUST116', 'customer_city': 'Paterson', 'customer_state': 'NJ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW117', 'date': '2024-08-22', 'product_category': 'Keyboards', 'product_name': 'Compact 60% Gaming KB', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 99.99, 'total_amount': 99.99, 'customer_id': 'CUST117', 'customer_city': 'Overland Park', 'customer_state': 'KS', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW118', 'date': '2024-08-24', 'product_category': 'Mice', 'product_name': 'Wireless Presenter Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 79.99, 'total_amount': 79.99, 'customer_id': 'CUST118', 'customer_city': 'Sioux Falls', 'customer_state': 'SD', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW119', 'date': '2024-08-26', 'product_category': 'Headphones', 'product_name': 'Fitness Waterproof HP', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 89.99, 'total_amount': 89.99, 'customer_id': 'CUST119', 'customer_city': 'Springfield', 'customer_state': 'MO', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW120', 'date': '2024-08-28', 'product_category': 'Storage', 'product_name': 'Backup Drive 8TB Desktop', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 199.99, 'total_amount': 199.99, 'customer_id': 'CUST120', 'customer_city': 'Independence', 'customer_state': 'MO', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW121', 'date': '2024-08-30', 'product_category': 'Laptops', 'product_name': 'Budget Gaming Laptop', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 999.99, 'total_amount': 999.99, 'customer_id': 'CUST121', 'customer_city': 'Peoria', 'customer_state': 'IL', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW122', 'date': '2024-09-01', 'product_category': 'Smartphones', 'product_name': 'Gaming Phone RGB', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 849.99, 'total_amount': 849.99, 'customer_id': 'CUST122', 'customer_city': 'Richmond', 'customer_state': 'VA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW123', 'date': '2024-09-03', 'product_category': 'Graphics Cards', 'product_name': 'Budget Entry GPU 1660', 'brand': 'GraphiTech', 'quantity': 2, 'unit_price': 249.99, 'total_amount': 499.98, 'customer_id': 'CUST123', 'customer_city': 'Cape Coral', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW124', 'date': '2024-09-05', 'product_category': 'Tablets', 'product_name': 'Gaming Tablet Controller', 'brand': 'TabCorp', 'quantity': 1, 'unit_price': 399.99, 'total_amount': 399.99, 'customer_id': 'CUST124', 'customer_city': 'Springfield', 'customer_state': 'IL', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW125', 'date': '2024-09-07', 'product_category': 'Desktop PCs', 'product_name': 'Budget Family Desktop', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 449.99, 'total_amount': 449.99, 'customer_id': 'CUST125', 'customer_city': 'Eugene', 'customer_state': 'OR', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW126', 'date': '2024-09-09', 'product_category': 'Monitors', 'product_name': 'Budget Gaming Monitor 24"', 'brand': 'DisplayPro', 'quantity': 2, 'unit_price': 229.99, 'total_amount': 459.98, 'customer_id': 'CUST126', 'customer_city': 'Santa Rosa', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW127', 'date': '2024-09-11', 'product_category': 'Keyboards', 'product_name': 'Office Quiet Keyboard', 'brand': 'PeriphTech', 'quantity': 3, 'unit_price': 39.99, 'total_amount': 119.97, 'customer_id': 'CUST127', 'customer_city': 'Chattanooga', 'customer_state': 'TN', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW128', 'date': '2024-09-13', 'product_category': 'Mice', 'product_name': 'Gaming Mouse RGB Wired', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 49.99, 'total_amount': 49.99, 'customer_id': 'CUST128', 'customer_city': 'Oceanside', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW129', 'date': '2024-09-15', 'product_category': 'Headphones', 'product_name': 'Studio Reference HP', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 399.99, 'total_amount': 399.99, 'customer_id': 'CUST129', 'customer_city': 'Garden Grove', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW130', 'date': '2024-09-17', 'product_category': 'Storage', 'product_name': 'High-Speed USB-C SSD', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 149.99, 'total_amount': 149.99, 'customer_id': 'CUST130', 'customer_city': 'Rancho Cucamonga', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW131', 'date': '2024-09-19', 'product_category': 'Laptops', 'product_name': 'Creator Laptop OLED', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1899.99, 'total_amount': 1899.99, 'customer_id': 'CUST131', 'customer_city': 'Port St. Lucie', 'customer_state': 'FL', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW132', 'date': '2024-09-21', 'product_category': 'Smartphones', 'product_name': 'Security Phone Encrypted', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 599.99, 'total_amount': 599.99, 'customer_id': 'CUST132', 'customer_city': 'McKinney', 'customer_state': 'TX', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW133', 'date': '2024-09-23', 'product_category': 'Graphics Cards', 'product_name': 'Ray Tracing GPU Elite', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1099.99, 'total_amount': 1099.99, 'customer_id': 'CUST133', 'customer_city': 'Sterling Heights', 'customer_state': 'MI', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW134', 'date': '2024-09-25', 'product_category': 'Tablets', 'product_name': 'Medical Tablet Hygiene', 'brand': 'TabCorp', 'quantity': 2, 'unit_price': 599.99, 'total_amount': 1199.98, 'customer_id': 'CUST134', 'customer_city': 'Sioux City', 'customer_state': 'IA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW135', 'date': '2024-09-27', 'product_category': 'Desktop PCs', 'product_name': 'Server Desktop Rack', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 1799.99, 'total_amount': 1799.99, 'customer_id': 'CUST135', 'customer_city': 'Coral Springs', 'customer_state': 'FL', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW136', 'date': '2024-09-29', 'product_category': 'Monitors', 'product_name': 'Designer Monitor 27" 4K', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 699.99, 'total_amount': 699.99, 'customer_id': 'CUST136', 'customer_city': 'Elizabeth', 'customer_state': 'NJ', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW137', 'date': '2024-10-01', 'product_category': 'Keyboards', 'product_name': 'Retro Mechanical Typewriter', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 159.99, 'total_amount': 159.99, 'customer_id': 'CUST137', 'customer_city': 'Concord', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW138', 'date': '2024-10-03', 'product_category': 'Mice', 'product_name': 'Precision CAD Gaming Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 89.99, 'total_amount': 89.99, 'customer_id': 'CUST138', 'customer_city': 'Topeka', 'customer_state': 'KS', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW139', 'date': '2024-10-05', 'product_category': 'Headphones', 'product_name': 'Podcast Recording HP', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 179.99, 'total_amount': 179.99, 'customer_id': 'CUST139', 'customer_city': 'Thousand Oaks', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW140', 'date': '2024-10-07', 'product_category': 'Storage', 'product_name': 'RAID Storage System 16TB', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 1299.99, 'total_amount': 1299.99, 'customer_id': 'CUST140', 'customer_city': 'Simi Valley', 'customer_state': 'CA', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW141', 'date': '2024-10-09', 'product_category': 'Laptops', 'product_name': 'Ultralight Business Laptop', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 1399.99, 'total_amount': 1399.99, 'customer_id': 'CUST141', 'customer_city': 'Denton', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW142', 'date': '2024-10-11', 'product_category': 'Smartphones', 'product_name': 'Night Photography Phone', 'brand': 'MobileMax', 'quantity': 1, 'unit_price': 1049.99, 'total_amount': 1049.99, 'customer_id': 'CUST142', 'customer_city': 'Visalia', 'customer_state': 'CA', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW143', 'date': '2024-10-13', 'product_category': 'Graphics Cards', 'product_name': 'Professional Render GPU', 'brand': 'GraphiTech', 'quantity': 1, 'unit_price': 1999.99, 'total_amount': 1999.99, 'customer_id': 'CUST143', 'customer_city': 'Thornton', 'customer_state': 'CO', 'payment_method': 'Bank Transfer', 'shipping_method': 'Express'}, {'order_id': 'HW144', 'date': '2024-10-15', 'product_category': 'Tablets', 'product_name': 'Student Note-Taking Tablet', 'brand': 'TabCorp', 'quantity': 3, 'unit_price': 299.99, 'total_amount': 899.97, 'customer_id': 'CUST144', 'customer_city': 'Roseville', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW145', 'date': '2024-10-17', 'product_category': 'Desktop PCs', 'product_name': 'Gaming PC RGB Ultimate', 'brand': 'CompuBuild', 'quantity': 1, 'unit_price': 2499.99, 'total_amount': 2499.99, 'customer_id': 'CUST145', 'customer_city': 'Olathe', 'customer_state': 'KS', 'payment_method': 'Bank Transfer', 'shipping_method': 'Freight'}, {'order_id': 'HW146', 'date': '2024-10-19', 'product_category': 'Monitors', 'product_name': 'Esports Monitor 240Hz', 'brand': 'DisplayPro', 'quantity': 1, 'unit_price': 549.99, 'total_amount': 549.99, 'customer_id': 'CUST146', 'customer_city': 'Allentown', 'customer_state': 'PA', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW147', 'date': '2024-10-21', 'product_category': 'Keyboards', 'product_name': 'Gaming Keyboard Wireless', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 169.99, 'total_amount': 169.99, 'customer_id': 'CUST147', 'customer_city': 'Beaumont', 'customer_state': 'TX', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW148', 'date': '2024-10-23', 'product_category': 'Mice', 'product_name': 'Customizable Gaming Mouse', 'brand': 'PeriphTech', 'quantity': 1, 'unit_price': 149.99, 'total_amount': 149.99, 'customer_id': 'CUST148', 'customer_city': 'Murfreesboro', 'customer_state': 'TN', 'payment_method': 'PayPal', 'shipping_method': 'Express'}, {'order_id': 'HW149', 'date': '2024-10-25', 'product_category': 'Headphones', 'product_name': 'Home Theater Headphones', 'brand': 'AudioMax', 'quantity': 1, 'unit_price': 299.99, 'total_amount': 299.99, 'customer_id': 'CUST149', 'customer_city': 'Ann Arbor', 'customer_state': 'MI', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW150', 'date': '2024-10-27', 'product_category': 'Storage', 'product_name': 'Backup Solution Complete', 'brand': 'StorageTech', 'quantity': 1, 'unit_price': 349.99, 'total_amount': 349.99, 'customer_id': 'CUST150', 'customer_city': 'Westminster', 'customer_state': 'CO', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}, {'order_id': 'HW151', 'date': '2024-10-29', 'product_category': 'Laptops', 'product_name': 'Gaming Laptop RTX Elite', 'brand': 'TechForce', 'quantity': 1, 'unit_price': 2199.99, 'total_amount': 2199.99, 'customer_id': 'CUST151', 'customer_city': 'Evansville', 'customer_state': 'IN', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW152', 'date': '2024-10-31', 'product_category': 'Smartphones', 'product_name': 'Halloween Special Phone', 'brand': 'MobileMax', 'quantity': 2, 'unit_price': 499.99, 'total_amount': 999.98, 'customer_id': 'CUST152', 'customer_city': 'Orange', 'customer_state': 'CA', 'payment_method': 'PayPal', 'shipping_method': 'Standard'}, {'order_id': 'HW153', 'date': '2024-11-02', 'product_category': 'Graphics Cards', 'product_name': 'Black Friday GPU Deal', 'brand': 'GraphiTech', 'quantity': 3, 'unit_price': 899.99, 'total_amount': 2699.97, 'customer_id': 'CUST153', 'customer_city': 'Cary', 'customer_state': 'NC', 'payment_method': 'Credit Card', 'shipping_method': 'Express'}, {'order_id': 'HW154', 'date': '2024-11-04', 'product_category': 'Tablets', 'product_name': 'Black Friday Tablet Deal', 'brand': 'TabCorp', 'quantity': 4, 'unit_price': 199.99, 'total_amount': 799.96, 'customer_id': 'CUST154', 'customer_city': 'Salem', 'customer_state': 'OR', 'payment_method': 'Credit Card', 'shipping_method': 'Standard'}]
Keep both raw and processed data in LiveDocs dashboards to track preprocessing results live, ensuring data consistency before training.
df.explode()
Here we are going to transform list-like entries in a DataFrame column into separate rows.
🧩 LLM Use Case: Splitting tokenized text into individual rows for embedding or analysis, or expand multiple LLM responses that return lists of results.
For example if your data column consists of list type data:
df_interests = pd.DataFrame({ "ID": [1, 2], "Interests": [["Full Stack", "Front End"], ["Machine Learning", "AI"]], "Tools": [["Javascript", "NodeJS"], ["Scikit-learn", \'TensorFlow\']] })
df.sample()
Often we will receive large datasets, but it is unnecessary to utilise the whole 10000 rows datasets if we are only going to, for example create mini batches work.
df.sample(5, random_state=42)
🧩 LLM Use Case: This is useful for picking random prompts for evaluation when you have a large dataset, or creating mini-batches for model fine-tuning.
df.plot()
df.hist()
df.boxplot()
Quick visualisation for distribution, trends and outliers directly from DataFrame.
Here we can visualise few things:
df.pivot_table()
This is to summarise and reshape data in pivot form.
This is a powerful method in Pandas used to create spreadsheet-style pivot tables.
It allows for the summarisation and aggregation of data, similar to pivot tables in Excel but with enhanced flexibility for data analysis.
pivot_df = df.pivot_table(index="product_category", values="total_amount", aggfunc=\'sum\')
🧩 LLM Use Case: This is useful to compare models across tasks (QA, summarization, coding), or ranking cost across different datasets.
df.to_json
Example: df.to_json("finetune_hardware_data.jsonl", orient="records", lines=True)
Finally, after all the analysis, cleaning, modifying, pivoting, we can now exports our DataFrames into JSONL format for AI training.
🧩 LLM Use Case: This is useful to create fine-tuning datasets, or format structured inputs/outputs for supervised learning.