aboutsummaryrefslogtreecommitdiff
path: root/src/openvic-dataloader/v2script/SimpleGrammar.hpp
Commit message (Collapse)AuthorAgeLines
* Add backslash identifier support to v2scriptadd/backslash-identifier Spartan3222024-07-22-21/+13
| | | | | | | | Add buffer::char_type size multiplier to max file size of string intern buffer Fix list grammar segfaults Fix diagnostic logger intern segfaults from buffer reallocation Fix non-string-supported CSV parser not supporting Victoria 2 CSV escaping behavior
* Fix string interning pointer invalidity for ASTsimplify-string-interning Spartan3222024-07-05-2/+15
| | | | | | | | | | | | | | | | | | Fix errorneous string intern compare Add symbol interning tests Optimize non-conversion identifier cases Add `File::size()` Add InstanceOf concept Remove `FlatValue::value(const symbol_interner_type&)` Add `AbstractSyntaxTree::intern/intern_cst(lexy::lexeme)` overload Add `DiagnosticLogger::intern/intern_cstr(lexy::lexeme)` overload Use pinned_vector to maintain string interning pointer validity for buffers Add vmcontainer submodule for pinned_vector pinned_vector reserves virtual memory at runtime using OS APIs to maintain pointer validity Remove Exception and RTTI requirement from range-v3 submodule
* Add runtime encoding detection and conversionfix/char-detection Spartan3222024-06-18-78/+229
| | | | | | | | | | | | | | | | | | | | | | | | | | Win-1251/1252 detection is a reduced C++ version of https://github.com/hsivonen/chardetng Add manually-specified encoding fallback Add default system encoding fallback Add error recovery to v2script Add unknown encoding detection warning Remove csv::Parser templating Fix lua files dropping data Update lexy to foonathan/lexy@1e5d99fa3826b1c3c8628d3a11117fb4fb4cc0d0 Remove exclusive reliance on lexy::default_encoding for v2script Move internal concepts to src/openvic-detail/InternalConcepts.hpp Move contents of DetectUtf8.hpp to src/detail/Detect.hpp Move openvic-dataloader/AbstractSyntaxTree.hpp to src Move DiagnosticLogger.hpp to src Move File.hpp to src Move openvic-dataloader/detail/utlity files to openvic-dataloader/detail Add ovdl::utility::type_concat Add ovdl::utility::type_prepend Add ovdl::utility::is_instance_of Overhaul parse error messages
* Expose dataloader includesfix/includes Spartan3222024-05-15-0/+1
| | | | | Fix dataloader file includes Fix leaking lexy includes
* Fix bugs in #37fix/error-handling Spartan3222024-05-11-3/+9
| | | | | | Fix error handling dropping errors Fix error handling segfaults Improve error messages
* Add `deps/dryad` -> https://github.com/Spartan322/dryadadd/dryad Spartan3222024-05-09-122/+140
| | | | | | | | | Add `deps/fmt` -> https://github.com/fmtlib/fmt Add `deps/range-v3` -> https://github.com/ericniebler/range-v3 Improve parser error and warning support Update .clang-format Update `deps/SCsub`
* Expanded v2script character list to support Windows-1251windows-1251 hop3112024-01-22-1/+12
|
* Fix includes Spartan3222024-01-18-1/+0
|
* Add grammar support for BEL, HT, LF, and CR characters Spartan3222023-10-20-4/+5
| | | | Add stripping of LF and CR characters if `v2script::grammar::StringExpression`'s `Options::NoStringEscape` is false
* Make File contents optional Spartan3222023-10-05-1/+1
| | | | Add lexy::nullopt support to String and List nodes
* Update lexy to main branch Spartan3222023-09-26-8/+7
| | | | | Cleanup and simplify SimpleGrammar data_specifier Add compile_commands.json to gitignore
* StatementListBlocks no longer require key = {...} Hop3112023-09-16-1/+2
|
* Add ParseOptions: Spartan3222023-09-15-26/+49
| | | | | | | | NoEscapeString to true to prevent escape behavior in strings Event and Decision grammars use string escaping (for now) Update lexy to latest master: Use `git submodule update --init --recursive`
* Add requirement comments Spartan3222023-09-10-2/+29
| | | | | | | | | | | Moved compound value expression to ValueExpression rule Fulfills: DAT-23, DAT-26, DAT-28, DAT-29, DAT-626, DAT-627, DAT-628, DAT-630, DAT-631, DAT-632, DAT-633, DAT-634, DAT-635, DAT-636, DAT-638, DAT-639, DAT-640, DAT-641, DAT-642, DAT-643
* Add Node Line/Column Generator Spartan3222023-09-05-18/+38
| | | | | | | | | | | | Fix Errors.hpp dependency on v2script/Parser.hpp Add node location print to headless/main.cpp Add Node::line_col << operator Add Node::cast_to WARNING: Takes advantage of non-standard behavior in unordered_multimap THIS IS A HACK FOR NOW Only GCC unordered_multimap::equal_range sees elements backwards Prefer moving off of unordered_multimap to something like EASTL hash_multimap
* Rework Grammar and Parser Spartan3222023-09-02-0/+120
Add proper headless binary construction: Includes basic validation Add Error and Warning structs to Parser Add FileNode pointer getter to Parser Change all `char8_t*` and `const char8_t` to `const char*` in Parser Add Parser move operators and Parser deconstructor Add BufferHandler PIMPL object to Parser Add UTF-8 file Warning to v2script Add proper Grammar value retrieval Add AbstractSyntaxTree for v2script data parser: Has compile-time embedded type information accessible at compile-time and runtime Has Tab-based print functionality Fix wrong environment reference for headless construction in SConstruct Add error retrieval Add BasicCallbackOStreamBuffer for callback streaming Add CallbackStreamBuffer for char Add CallbackWStreamBuffer for wchar_t Add BasicCallbackStream Add CallbackStream for char Add CallbackWStream for wchar_t Add grammar for events and decisions Add event_parse to Parser Add decision_parse to Parser Add .clang-format Ignore dirty lexy module Add CSV parser and grammar: Creates std::vector<csv::LineObject> for a list of lines Add BasicParser and BasicBufferHandler to reduce code reduplication