Skip to content

V1.4.20 - #637

Merged
flarco merged 44 commits into
mainfrom
v1.4.20
Sep 3, 2025
Merged

flarco merged 44 commits into
mainfrom
v1.4.20

Conversation

@flarco

@flarco flarco commented Aug 29, 2025 •

Copy link
Copy Markdown
Collaborator

Database and Connection Improvements

  • New Database Support: Added Arrow Flight SQL (FlightSQL) connection type
  • Connection URL Handling: Improved SFTP/FTP connection URL parsing with proper path handling
  • Decimal Precision Handling: Enhanced decimal number processing with better precision and scale management

File Processing Enhancements

  • XML File Support: Added comprehensive XML file parsing capabilities with custom decoder
  • File Splitting: Improved file splitting functionality with better chunking and manifest generation
  • Parquet Processing: Enhanced Parquet file handling with DuckDB integration

Data Type and Processing Improvements

  • Decimal Type Refactoring: Switched from float64 to decimal.Decimal for better precision
  • String Parsing Optimization: Refactored string parsing with better type detection and caching
  • Number Precision: Enhanced handling of high-precision numbers and scientific notation

Database Operation Updates

  • Merge Operations: Renamed "Upsert" operations to "Merge" across multiple database connectors
  • PostgreSQL Merge Strategy: Implemented sophisticated merge strategy using temporary tables
  • Transaction Handling: Improved transaction management for bulk operations

API Specification Enhancements

  • Sling Platform API Updates: Enhanced API specifications with improved pagination logic and state management
  • Stripe API Improvements: Fixed pagination issues with better handling of starting_after and ending_before parameters
  • Dynamic Base URL Configuration: Added support for dynamic base URL configuration using secrets

New LLM Documentation Guides

  • Pipeline Guide for LLMs: Comprehensive guide covering pipeline structure, task types, variables, control flow, and best practices
  • Python Integration Guide: guide for Sling Python bindings with usage patterns and examples

flarco added 30 commits August 26, 2025 08:18
@flarco
flarco merged commit dcff975 into main Sep 3, 2025
9 checks passed
@flarco
flarco deleted the v1.4.20 branch September 3, 2025 12:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant