large-datasets

Time Series Forecasting Projects – Research-oriented Python portfolio exploring classical and modern forecasting techniques, from Prophet to LightGBM, with EDA, feature engineering, and model evaluation on real-world datasets.

High-performance, MIT-licensed JavaScript data grid for large client-side datasets, with framework-agnostic Core and React packages.

High-performance spreadsheet engine built for scale, achieving sub-millisecond read latency and millisecond row-write latency at one million rows through virtualized scrolling and a three-tier query engine built on indexed keyset seeks, precomputed view ranks, and cursor-anchored jumps.

Financial dataset flat file reconstruction, applying data structuring, ETL, and SQL RDBMS best practices.

This project shows best practices for optimizing memory in Syncfusion JavaScript Pivot Table using virtual scrolling, paging, disposal, and server-side processing.

A program to analyze crime and sports data in Philadelphia to determine if a correlation exists between whether a Philly team's win/loss to a given team has an effect on the city's violent crime rate. Conclusion--> If the Flyer's lose to the Redwings, stay out of Center City.

Streaming-first Laravel package for filtering, search, sorting, import, and export at any scale, with queue-native execution and low memory usage.

An analysis of the Home advantage in NBA games

Official FastGrid and FastSheet wrappers and project generators for Angular, React, Vue, Svelte and HTML/JavaScript. High-performance data grids, tree grids, virtual scrolling, large datasets, pivot grids, XLSX/CSV spreadsheets, formulas and AI-assisted operations by COQsoft.

A modern, flexible and scalable Geographic Information System (GIS) designed for creating and editing geographic data, developed for seamless integration into web applications.

Dealing with 100000000 rows of data in a table.

Streaming analysis of 1.47M tweets using Unix/Bash pipelines, CSV-safe Python parsing, and R aggregation/visualisation. | 使用 Unix/Bash 流式管道、CSV 安全 Python 解析与 R 聚合/可视化分析 147 万条推文。

Efficient Serving of Large-scale Vector Search with Sharded Indexes

React, Vue, Angular, CSV, Parquet, and 10M-row benchmark examples for the AeroPivot JavaScript pivot table web component.

A web scraper designed to collect and analyze public resumes for research purposes.

A professional, web-based application designed specifically for handling and analyzing large CSV and text files that are too massive for conventional spreadsheet software. Built with Python and Flask, it provides a robust, browser-based interface for searching, previewing, and exporting data from files that can exceed several gigabytes in size.

Turn any data export into a filterable, chart-driven data explorer — browse 1M+ rows from static files, zero backend

PatentPulse is a locally owned, 1.6 TB corpus of USPTO patent grants and published applications. It downloads official weekly XML dumps, stream-parses them without loading an archive into memory, and writes normalized SQLite and JSON Lines outputs for search, tokenization, embeddings, and model training.

This project used SparkSQL and PySpark to analyze home sales data, optimizing performance with caching and partitioning by build date.