aboutsummaryrefslogtreecommitdiff
path: root/include/openvic-dataloader
Commit message (Collapse)AuthorAgeLines
* Fix string interning pointer invalidity for ASTsimplify-string-interning Spartan3222024-07-05-6/+272
| | | | | | | | | | | | | | | | | | Fix errorneous string intern compare Add symbol interning tests Optimize non-conversion identifier cases Add `File::size()` Add InstanceOf concept Remove `FlatValue::value(const symbol_interner_type&)` Add `AbstractSyntaxTree::intern/intern_cst(lexy::lexeme)` overload Add `DiagnosticLogger::intern/intern_cstr(lexy::lexeme)` overload Use pinned_vector to maintain string interning pointer validity for buffers Add vmcontainer submodule for pinned_vector pinned_vector reserves virtual memory at runtime using OS APIs to maintain pointer validity Remove Exception and RTTI requirement from range-v3 submodule
* Add unit testsadd/unit-testing Spartan3222024-06-22-19/+67
| | | | | | | | | | | | | Make github action tests run explicit Fix dropping annotation list for Errors Fix potential empty get_errors crashes Fix incorrect csv error behavior Add use_sep for `LineObject` and `std::vector<LineObject>` Remove constexpr of load_from_buffer and load_from_string for parsers Add snitch-org/snitch@d6632123cc8d13bdbc5cd60fd6741b9e0f635e82 Make versioned submodules ignore dirty Add tests/bin/* to gitignore
* Add runtime encoding detection and conversionfix/char-detection Spartan3222024-06-18-1094/+248
| | | | | | | | | | | | | | | | | | | | | | | | | | Win-1251/1252 detection is a reduced C++ version of https://github.com/hsivonen/chardetng Add manually-specified encoding fallback Add default system encoding fallback Add error recovery to v2script Add unknown encoding detection warning Remove csv::Parser templating Fix lua files dropping data Update lexy to foonathan/lexy@1e5d99fa3826b1c3c8628d3a11117fb4fb4cc0d0 Remove exclusive reliance on lexy::default_encoding for v2script Move internal concepts to src/openvic-detail/InternalConcepts.hpp Move contents of DetectUtf8.hpp to src/detail/Detect.hpp Move openvic-dataloader/AbstractSyntaxTree.hpp to src Move DiagnosticLogger.hpp to src Move File.hpp to src Move openvic-dataloader/detail/utlity files to openvic-dataloader/detail Add ovdl::utility::type_concat Add ovdl::utility::type_prepend Add ovdl::utility::is_instance_of Overhaul parse error messages
* Expose dataloader includesfix/includes Spartan3222024-05-15-14/+1
| | | | | Fix dataloader file includes Fix leaking lexy includes
* Fix bugs in #37fix/error-handling Spartan3222024-05-11-43/+64
| | | | | | Fix error handling dropping errors Fix error handling segfaults Improve error messages
* Add `deps/dryad` -> https://github.com/Spartan322/dryadadd/dryad Spartan3222024-05-09-427/+1372
| | | | | | | | | Add `deps/fmt` -> https://github.com/fmtlib/fmt Add `deps/range-v3` -> https://github.com/ericniebler/range-v3 Improve parser error and warning support Update .clang-format Update `deps/SCsub`
* Fixed BasicParser::_file_path relying on externally controlled memory hop3112024-01-22-2/+5
|
* Fix includes Spartan3222024-01-18-9/+2
|
* Change nodes to support list checks: Spartan3222023-11-04-25/+22
| | | | | | | EventNode DecisionNode EventMtthModifierNode ExecutionListNode
* Add grammar support for BEL, HT, LF, and CR characters Spartan3222023-10-20-13/+13
| | | | Add stripping of LF and CR characters if `v2script::grammar::StringExpression`'s `Options::NoStringEscape` is false
* Add Lua Defines parsing Spartan3222023-10-12-0/+1
|
* Make File contents optional Spartan3222023-10-05-0/+12
| | | | Add lexy::nullopt support to String and List nodes
* Overhaul CSV parsing and align with Victoria 2 CSVs Spartan3222023-09-14-1/+1
| | | | | | | | | | Fix "" not being converted into " in Csv files Move duplicated Grammar in CsvGrammar.hpp to Grammar.inc Add ParseOptions to simplify template options Add StringValue disable option: Inlines value escapes Add strings namespace to grammars for `ParseOptions.SupportStrings = true` Add string parse handling to parse_csv via argument
* Add Node Line/Column Generator Spartan3222023-09-05-27/+224
| | | | | | | | | | | | Fix Errors.hpp dependency on v2script/Parser.hpp Add node location print to headless/main.cpp Add Node::line_col << operator Add Node::cast_to WARNING: Takes advantage of non-standard behavior in unordered_multimap THIS IS A HACK FOR NOW Only GCC unordered_multimap::equal_range sees elements backwards Prefer moving off of unordered_multimap to something like EASTL hash_multimap
* Add Windows-1252 CSV Parser Spartan3222023-09-04-5/+51
| | | | | | | | | | | | Fix CsvGrammar counting behavior Add csv parse argument to headless/main.cpp Change LineObject contained value type to pair Add ostream print to LineObject Add vscode tasks.json Add vscode launch.json Move csv::Parser template class specialization to end of Parser.cpp Add detail/ClassExport.hpp to assist compiler export
* Add csv::Parser.get_lines() implementation Spartan3222023-09-03-1/+1
| | | | Change csv::Parser.get_lines() return type to const ref vector
* Add github actions and workflow Spartan3222023-09-02-11/+31
|
* Rework Grammar and Parser Spartan3222023-09-02-13/+675
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add proper headless binary construction: Includes basic validation Add Error and Warning structs to Parser Add FileNode pointer getter to Parser Change all `char8_t*` and `const char8_t` to `const char*` in Parser Add Parser move operators and Parser deconstructor Add BufferHandler PIMPL object to Parser Add UTF-8 file Warning to v2script Add proper Grammar value retrieval Add AbstractSyntaxTree for v2script data parser: Has compile-time embedded type information accessible at compile-time and runtime Has Tab-based print functionality Fix wrong environment reference for headless construction in SConstruct Add error retrieval Add BasicCallbackOStreamBuffer for callback streaming Add CallbackStreamBuffer for char Add CallbackWStreamBuffer for wchar_t Add BasicCallbackStream Add CallbackStream for char Add CallbackWStream for wchar_t Add grammar for events and decisions Add event_parse to Parser Add decision_parse to Parser Add .clang-format Ignore dirty lexy module Add CSV parser and grammar: Creates std::vector<csv::LineObject> for a list of lines Add BasicParser and BasicBufferHandler to reduce code reduplication
* Initial structural commit Spartan3222023-07-26-0/+27
generated by our cgit fork (git 2.39.0) at 2024-01-23 02:24:14 +0100