aboutsummaryrefslogtreecommitdiff
path: root/src/openvic-dataloader/detail
Commit message (Collapse)AuthorAgeLines
* Remove pointless append in conversionclean/useless-append Spartan3222024-08-03-3/+0
|
* Add `\x8F` to `Ę` conversion for Windows-1252fix/polish-todos Spartan3222024-08-02-44/+66
| | | | | | | | | To support special vanilla Polish TODOs that break utf8 Add CSV Win1252->Utf8 conversion tests Fix map_value warning not triggering Optimize for ascii characters
* Fix string interning pointer invalidity for ASTsimplify-string-interning Spartan3222024-07-05-5/+9
| | | | | | | | | | | | | | | | | | Fix errorneous string intern compare Add symbol interning tests Optimize non-conversion identifier cases Add `File::size()` Add InstanceOf concept Remove `FlatValue::value(const symbol_interner_type&)` Add `AbstractSyntaxTree::intern/intern_cst(lexy::lexeme)` overload Add `DiagnosticLogger::intern/intern_cstr(lexy::lexeme)` overload Use pinned_vector to maintain string interning pointer validity for buffers Add vmcontainer submodule for pinned_vector pinned_vector reserves virtual memory at runtime using OS APIs to maintain pointer validity Remove Exception and RTTI requirement from range-v3 submodule
* Add runtime encoding detection and conversionfix/char-detection Spartan3222024-06-18-179/+2330
| | | | | | | | | | | | | | | | | | | | | | | | | | Win-1251/1252 detection is a reduced C++ version of https://github.com/hsivonen/chardetng Add manually-specified encoding fallback Add default system encoding fallback Add error recovery to v2script Add unknown encoding detection warning Remove csv::Parser templating Fix lua files dropping data Update lexy to foonathan/lexy@1e5d99fa3826b1c3c8628d3a11117fb4fb4cc0d0 Remove exclusive reliance on lexy::default_encoding for v2script Move internal concepts to src/openvic-detail/InternalConcepts.hpp Move contents of DetectUtf8.hpp to src/detail/Detect.hpp Move openvic-dataloader/AbstractSyntaxTree.hpp to src Move DiagnosticLogger.hpp to src Move File.hpp to src Move openvic-dataloader/detail/utlity files to openvic-dataloader/detail Add ovdl::utility::type_concat Add ovdl::utility::type_prepend Add ovdl::utility::is_instance_of Overhaul parse error messages
* Fix bugs in #37fix/error-handling Spartan3222024-05-11-3/+10
| | | | | | Fix error handling dropping errors Fix error handling segfaults Improve error messages
* Add `deps/dryad` -> https://github.com/Spartan322/dryadadd/dryad Spartan3222024-05-09-217/+559
| | | | | | | | | Add `deps/fmt` -> https://github.com/fmtlib/fmt Add `deps/range-v3` -> https://github.com/ericniebler/range-v3 Improve parser error and warning support Update .clang-format Update `deps/SCsub`
* Fixed BasicParser::_file_path relying on externally controlled memory hop3112024-01-22-5/+18
|
* Fix includes Spartan3222024-01-18-2/+1
|
* Fix BufferHandler assuming buffers of size 0 are invalid Spartan3222023-10-05-1/+1
|
* Add Node Line/Column Generator Spartan3222023-09-05-1/+5
| | | | | | | | | | | | Fix Errors.hpp dependency on v2script/Parser.hpp Add node location print to headless/main.cpp Add Node::line_col << operator Add Node::cast_to WARNING: Takes advantage of non-standard behavior in unordered_multimap THIS IS A HACK FOR NOW Only GCC unordered_multimap::equal_range sees elements backwards Prefer moving off of unordered_multimap to something like EASTL hash_multimap
* Add Windows-1252 CSV Parser Spartan3222023-09-04-0/+2
| | | | | | | | | | | | Fix CsvGrammar counting behavior Add csv parse argument to headless/main.cpp Change LineObject contained value type to pair Add ostream print to LineObject Add vscode tasks.json Add vscode launch.json Move csv::Parser template class specialization to end of Parser.cpp Add detail/ClassExport.hpp to assist compiler export
* Add github actions and workflow Spartan3222023-09-02-3/+4
|
* Rework Grammar and Parser Spartan3222023-09-02-0/+357
Add proper headless binary construction: Includes basic validation Add Error and Warning structs to Parser Add FileNode pointer getter to Parser Change all `char8_t*` and `const char8_t` to `const char*` in Parser Add Parser move operators and Parser deconstructor Add BufferHandler PIMPL object to Parser Add UTF-8 file Warning to v2script Add proper Grammar value retrieval Add AbstractSyntaxTree for v2script data parser: Has compile-time embedded type information accessible at compile-time and runtime Has Tab-based print functionality Fix wrong environment reference for headless construction in SConstruct Add error retrieval Add BasicCallbackOStreamBuffer for callback streaming Add CallbackStreamBuffer for char Add CallbackWStreamBuffer for wchar_t Add BasicCallbackStream Add CallbackStream for char Add CallbackWStream for wchar_t Add grammar for events and decisions Add event_parse to Parser Add decision_parse to Parser Add .clang-format Ignore dirty lexy module Add CSV parser and grammar: Creates std::vector<csv::LineObject> for a list of lines Add BasicParser and BasicBufferHandler to reduce code reduplication