aboutsummaryrefslogtreecommitdiff
path: root/src/openvic-dataloader/csv
Commit message (Collapse)AuthorAgeLines
* Add backslash identifier support to v2scriptadd/backslash-identifier Spartan3222024-07-22-14/+26
| | | | | | | | Add buffer::char_type size multiplier to max file size of string intern buffer Fix list grammar segfaults Fix diagnostic logger intern segfaults from buffer reallocation Fix non-string-supported CSV parser not supporting Victoria 2 CSV escaping behavior
* Add unit testsadd/unit-testing Spartan3222024-06-22-5/+15
| | | | | | | | | | | | | Make github action tests run explicit Fix dropping annotation list for Errors Fix potential empty get_errors crashes Fix incorrect csv error behavior Add use_sep for `LineObject` and `std::vector<LineObject>` Remove constexpr of load_from_buffer and load_from_string for parsers Add snitch-org/snitch@d6632123cc8d13bdbc5cd60fd6741b9e0f635e82 Make versioned submodules ignore dirty Add tests/bin/* to gitignore
* Add runtime encoding detection and conversionfix/char-detection Spartan3222024-06-18-230/+222
| | | | | | | | | | | | | | | | | | | | | | | | | | Win-1251/1252 detection is a reduced C++ version of https://github.com/hsivonen/chardetng Add manually-specified encoding fallback Add default system encoding fallback Add error recovery to v2script Add unknown encoding detection warning Remove csv::Parser templating Fix lua files dropping data Update lexy to foonathan/lexy@1e5d99fa3826b1c3c8628d3a11117fb4fb4cc0d0 Remove exclusive reliance on lexy::default_encoding for v2script Move internal concepts to src/openvic-detail/InternalConcepts.hpp Move contents of DetectUtf8.hpp to src/detail/Detect.hpp Move openvic-dataloader/AbstractSyntaxTree.hpp to src Move DiagnosticLogger.hpp to src Move File.hpp to src Move openvic-dataloader/detail/utlity files to openvic-dataloader/detail Add ovdl::utility::type_concat Add ovdl::utility::type_prepend Add ovdl::utility::is_instance_of Overhaul parse error messages
* Fix bugs in #37fix/error-handling Spartan3222024-05-11-6/+12
| | | | | | Fix error handling dropping errors Fix error handling segfaults Improve error messages
* Add `deps/dryad` -> https://github.com/Spartan322/dryadadd/dryad Spartan3222024-05-09-159/+231
| | | | | | | | | Add `deps/fmt` -> https://github.com/fmtlib/fmt Add `deps/range-v3` -> https://github.com/ericniebler/range-v3 Improve parser error and warning support Update .clang-format Update `deps/SCsub`
* Fix includes Spartan3222024-01-18-1/+0
|
* Fix early termination on newline in CSV file hop3112023-12-10-3/+3
|
* Make values optional for CSV lines Spartan3222023-10-13-2/+4
|
* Simplify csv grammar to one file Spartan3222023-10-13-180/+220
| | | | Remove hacky include behavior for CSVGrammar
* Overhaul CSV parsing and align with Victoria 2 CSVs Spartan3222023-09-14-241/+183
| | | | | | | | | | Fix "" not being converted into " in Csv files Move duplicated Grammar in CsvGrammar.hpp to Grammar.inc Add ParseOptions to simplify template options Add StringValue disable option: Inlines value escapes Add strings namespace to grammars for `ParseOptions.SupportStrings = true` Add string parse handling to parse_csv via argument
* Add Windows-1252 CSV Parser Spartan3222023-09-04-46/+227
| | | | | | | | | | | | Fix CsvGrammar counting behavior Add csv parse argument to headless/main.cpp Change LineObject contained value type to pair Add ostream print to LineObject Add vscode tasks.json Add vscode launch.json Move csv::Parser template class specialization to end of Parser.cpp Add detail/ClassExport.hpp to assist compiler export
* Add csv::Parser.get_lines() implementation Spartan3222023-09-03-0/+4
| | | | Change csv::Parser.get_lines() return type to const ref vector
* Rework Grammar and Parser Spartan3222023-09-02-0/+280
Add proper headless binary construction: Includes basic validation Add Error and Warning structs to Parser Add FileNode pointer getter to Parser Change all `char8_t*` and `const char8_t` to `const char*` in Parser Add Parser move operators and Parser deconstructor Add BufferHandler PIMPL object to Parser Add UTF-8 file Warning to v2script Add proper Grammar value retrieval Add AbstractSyntaxTree for v2script data parser: Has compile-time embedded type information accessible at compile-time and runtime Has Tab-based print functionality Fix wrong environment reference for headless construction in SConstruct Add error retrieval Add BasicCallbackOStreamBuffer for callback streaming Add CallbackStreamBuffer for char Add CallbackWStreamBuffer for wchar_t Add BasicCallbackStream Add CallbackStream for char Add CallbackWStream for wchar_t Add grammar for events and decisions Add event_parse to Parser Add decision_parse to Parser Add .clang-format Ignore dirty lexy module Add CSV parser and grammar: Creates std::vector<csv::LineObject> for a list of lines Add BasicParser and BasicBufferHandler to reduce code reduplication
generated by our cgit fork (git 2.39.0) at 2024-01-23 02:24:14 +0100