js/src/frontend/TokenStream.h
3ea769ff9a9a04270cd445f6acd4ea0714650eb1
created 2019-01-14 23:01 -0500
pushed 2019-03-11 13:01 +0000
Jeff Walden Jeff Walden - Bug 1519097 - Implement the Hashbang Grammar proposal in JavaScript to allow a '#!' line at the very start of a script/module to be treated as beginning a single-line comment. r=arai
b7f57b3558916ec78e96b05566faa0e12083e972
created 2019-02-28 20:14 -0800
pushed 2019-03-11 13:01 +0000
Jeff Walden Jeff Walden - Bug 1519097 - Relax the meaning of 'poisoned' SourceUnits to allow SourceUnits initialized with null units and zero length to be considered not-poisoned. r=bustage
24572052e60fdec6f3ce83efdf0e12633d05d0d8
created 2019-03-01 05:02 +0200
pushed 2019-03-11 13:01 +0000
shindli shindli - Backed out 2 changesets (bug 1531199, bug 1519097) for spidermonkey build bustages in /builds/worker/workspace/build/src/js/src/frontend/TokenStream.h:1176 CLOSED TREE
0bb343e7c6cc77a950065579d9fc31e0be4c3334
created 2019-01-14 23:01 -0500
pushed 2019-03-11 13:01 +0000
Jeff Walden Jeff Walden - Bug 1519097 - Implement the Hashbang Grammar proposal in JavaScript to allow a '#!' line at the very start of a script/module to be treated as beginning a single-line comment. r=arai
9adeff2c423fc4ac047b4ddbdbb9b8e64ce7fdac
created 2019-02-16 20:20 +0100
pushed 2019-03-11 13:01 +0000
Sylvestre Ledru Sylvestre Ledru - Bug 1519636 - Reformat recent changes to the Google coding style r=Ehsan
fdb6f449e8c0858442997e9fdf5d35fbc35d5fec
created 2019-02-14 15:03 +0000
pushed 2019-03-11 13:01 +0000
Andy Wingo Andy Wingo - Bug 1527860 - Remove ENABLE_BIGINT #ifdef r=jandem,froydnj
ee32392ef5b3ce7e5f72cf052458a2dd139be386
created 2019-01-08 11:33 +0900
pushed 2019-01-21 13:03 +0000
Tooru Fujisawa Tooru Fujisawa - Bug 1502792 - Part 2: Add ErrorReportMixin which implements error reporting methods, and make them available in Parser and Tokenizer. r=jwalden
8a78a7d20a1f7d99d8680140a20353664179b6f1
created 2019-01-08 11:33 +0900
pushed 2019-01-21 13:03 +0000
Tooru Fujisawa Tooru Fujisawa - Bug 1502792 - Part 1: Use va_list* instead of va_list in ReportCompile{Error,Warning} parameter type. r=jwalden
9ac226702f1265c4b1b4c1bdf43951d6dbe496d1
created 2018-11-10 23:29 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Change column-number-computing code so that column numbers can be quickly converted to code *point* counts from the code *unit* counts they are now, simply by changing a single #define. (This gets a bit of patching landed and in the tree, without taking the final step to change observable behavior.) r=tcampbell
ef2b0280d80a504a124e7c0a1b453b0765bd1489
created 2018-11-10 22:06 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Rename fillExcludingContext to fillExceptingContext, and distribute line/column-setting responsibilities across a version of it in any-chars code and a version in Unit-aware code. r=tcampbell
48910f558ce6baf1d1bbf9da4f01a8dcf6618327
created 2018-11-10 21:56 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Change fake-column computations to work from (LineToken, uint32_t offset) inputs. r=tcampbell
5cd58657ebb8953a54fb1ab298a705466bdc09de
created 2018-11-10 21:52 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Introduce a LineToken concept so that users can't accidentally do the work of determining a SourceCoords vector index twice. r=tcampbell
68a802e40bf954534fcb42851361f9f54bbc5f38
created 2018-11-10 21:44 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Use GeneralTokenStreamChars::computeLineAndColumn in more places so they're column-aware-ready. r=tcampbell
2880ee701d5b96d7e482f9c7de0d35ab0fd6f4bb
created 2018-11-10 21:43 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Rename a bunch of different SourceCoords concepts for increased readability. r=tcampbell
569ad5db4a3b7ecb1b425993c5eac2846bccd7e0
created 2018-11-10 21:23 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Replace a FunctionBox::setStart function with a GeneralTokenStream::setFunctionStart that'll have proper column handling when the column-counting guts are redone. r=tcampbell
fe69693975eff1feff452a01d48b3bba0dee567e
created 2018-11-10 21:21 -0800
pushed 2019-01-21 13:03 +0000
Jeff Walden Jeff Walden - Bug 1504947 - Add a GeneralTokenStream::computeLineAndColumn function that delegates to the any-chars version of the same, allowing the affected callers to be rewritten to their final form in advance of the guts of the UTF-8/16 column-counting fix. r=tcampbell
66eb1f485c1a3ea81372758bc92292c9428b17cd
created 2018-12-01 04:52 +0900
pushed 2018-12-03 16:23 +0000
Tooru Fujisawa Tooru Fujisawa - Bug 1511393 - Use c-basic-offset: 2 in Emacs mode line for C/C++ code. r=nbp
e4712449ba4303cef134ba0b3f1bea13fbd50c4a
created 2018-11-30 16:39 +0100
pushed 2018-12-03 16:23 +0000
Benjamin Bouvier Benjamin Bouvier - Bug 1511383: Update vim modelines after clang-format; r=sylvestre
6f3709b3878117466168c40affa7bca0b60cf75b
created 2018-11-30 11:46 +0100
pushed 2018-12-03 16:23 +0000
Sylvestre Ledru Sylvestre Ledru - Bug 1511181 - Reformat everything to the Google coding style r=ehsan a=clang-format
971f97ac3013c6c8ee106a0b7c5699194c90b8ab
created 2018-11-05 18:55 -0800
pushed 2018-12-03 16:23 +0000
Jeff Walden Jeff Walden - Bug 1504802 - Translate Unit-relevant offsets into sourceUnits, into char16_t-relevant offsets with respect to the just-computed lineOfContext, when reporting a syntax error and adding a line of context to it. r=arai
4b7c53151158f12abeadcd76779a26a94a9fd26b
created 2018-11-19 17:02 +0000
pushed 2018-12-03 16:23 +0000
Jan de Mooij Jan de Mooij - Bug 1508065 - Change JS_PUBLIC_{API,DATA} and JS_FRIEND_{API,DATA} to be more like similar macros to avoid confusing clang-format. r=tcampbell
56f220f7a98f9ca941912ed1b9e69518f49c0d79
created 2018-11-15 15:01 +0000
pushed 2018-12-03 16:23 +0000
Andy Wingo Andy Wingo - Bug 1505849 - Implement parser support for BigInt literals r=terpri,jandem
fcb81b7195327dd656db7ee5d1fd5af461ed0c6e
created 2018-11-05 18:55 -0800
pushed 2018-12-03 16:23 +0000
Jeff Walden Jeff Walden - Bug 1504463 - Report the trailing invalid code unit, not the lead code unit, when tokenizing invalid UTF-8 where the lead unit is fine but a trailing unit, isn't. r=arai
d0b577458d53f59ecabc3556ce04a27a8e8eb6d0
created 2018-10-25 18:25 +0000
pushed 2018-12-03 16:23 +0000
Ashley Hauck Ashley Hauck - Bug 1499448 - Implement syntax for public and private fields. r=jorendorff
0522e105ea10e64fcd421dd082e0ba1cd02dfae1
created 2018-10-16 15:41 -0700
pushed 2018-10-18 18:37 +0000
Jeff Walden Jeff Walden - Rename the current CharT typename parameter, used for either char16_t or mozilla::Utf8Unit, to Unit -- so that CharT can be used for actual C++ character types, when such are needed to intermesh with character-demanding APIs. Also change a few "chars" in function/variable names to "units" for consistency. No bug, rs=jorendorff over IRC
9f7beee7269b10833e0ca8446195cc354dac63c3
created 2018-09-06 10:31 +0200
pushed 2018-10-15 21:07 +0000
Jan de Mooij Jan de Mooij - Bug 1488698 - Always use braces for if/for/while statements in js/src/frontend, part 4. r=jorendorff
fcae304349d841a9bb2850c59dcc70680b857aa7
created 2018-08-30 20:10 +0100
pushed 2018-09-03 16:13 +0000
Jon Coppeard Jon Coppeard - Bug 1486782 - Remove unnecessary includes of gc/Zone.h r=sfink
7d07908ee08acfa5333806b907bce7fb20c59dc1
created 2018-08-30 20:10 +0100
pushed 2018-09-03 16:13 +0000
Jon Coppeard Jon Coppeard - Bug 1486730 - Remove some unnecessary includes from js/src/frontend r=Waldo
1fb7ddfad86d5e085c4f2af23a2519d37e45a3e4
created 2018-08-24 21:25 -0500
pushed 2018-08-30 12:18 +0000
Jeff Walden Jeff Walden - Bug 1486577 - Make all users of the various *CompileOptions classes #include "js/CompileOptions.h" so that nothing but that file has to know about these classes having a JS_PUBLIC_API on them, that would have to be present in forward-declarations. r=jandem
805445fc768f0159334f0e066f62c543be14c2d8
created 2018-07-25 20:11 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478587 - Return the result of CodeUnitValue(), not a CharT, from GeneralTokenStreamChars::getCodeUnit. r=arai
bb0dd8b2d4e2cb93766120a7ef82746892639f26
created 2018-07-25 20:11 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478587 - Invoke TokenStreamChars::getNonAsciiCodePointDontNormalize passing CharT lead (not int32_t). r=arai
fd12c0a357b378feaf48266389bfa0e5c27d766b
created 2018-07-29 13:33 +0300
pushed 2018-08-24 17:49 +0000
shindli shindli - Backed out 11 changesets (bug 1478892, bug 1478587) for build bustages in ../../../dist/bin/gdb-tests on a CLOSED TREE
9546bfc93c7af1391bbcf901ed1ddc1304da8b80
created 2018-07-25 20:11 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478587 - Return the result of CodeUnitValue(), not a CharT, from GeneralTokenStreamChars::getCodeUnit. r=arai
a47cd872a700a331b13c598a26ec956a28d14308
created 2018-07-25 20:11 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478587 - Invoke TokenStreamChars::getNonAsciiCodePointDontNormalize passing CharT lead (not int32_t). r=arai
dad6f1d062719f26f6f934c2e8a5225ab2491351
created 2018-07-17 21:21 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Make atomizeSourceChars take a Span<CharT>, and define a specialization for UTF-8. r=arai
38216fdba3ddea982cc4d3178c3b2c75637f71a1
created 2018-07-17 21:13 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Move TokenStreamChars::getCodePoint to a generalized TokenStreamSpecific::getCodePoint that works for any CharT. r=arai
107211d728e60e9b069c2d0107241f74b575d576
created 2018-06-29 13:46 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Implement TokenStreamChars::getNonAsciiCodePoint for UTF-8. r=arai
46c400e4a018c1cb827266441018a5c43a84f8f5
created 2018-07-09 16:21 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Implement consumeRestOfSingleLine for UTF-8. r=arai
45b34e5af77e953970b0497f1ab20690333457d8
created 2018-07-18 22:46 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Implement getNonAsciiCodePointDontNormalize for UTF-8. r=arai
292bd4af4056fd252939f0b9a31ad71ce9270785
created 2018-07-25 14:51 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Implement SourceUnits::peekCodePoint for UTF-8. r=arai
0ccbc10cd6a1b7ce53f852fb8f7f81cac1ecc31f
created 2018-07-25 14:46 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Replace SpecializedTokenStreamCharsBase::consumeRestOfSingleLineComment with an infallible SourceUnits::consumeRestOfSingleLineComment, in light of the fact that the UTF-8 version can just stop consuming code points when an encoding error is encountered, leaving error-reporting to whatever actually tries to consume the first code point of the "next" line. r=arai
66952e88e68c22576f6ddc0600d0883d0b7dba6a
created 2018-07-25 14:24 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478170 - Make SourceUnits::findWindow{Start,End} const because they can/should be. r=arai
d93c6f631ca76e457c819b7bd74039395c33fded
created 2018-07-25 14:24 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478045 - Remove TokenStreamChars::{ungetCodePointIgnoreEOL,ungetNonAsciiNormalizedCodePoint} as unused now that SourceUnits::{peek,consumeKnown}CodePoint have replaced them. r=arai
b4a63f805c039170375033eff016d850192cf3d6
created 2018-07-25 14:24 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1478045 - Implement SourceUnits::{peek,consumeKnown}CodePoint for the uncommon cases where a code point must be gotten, tested against one or more predicates, then sometimes ungotten based on those predicates. (This is unfortunately a bit subtle, but getting and ungetting is arguably worse, because ungetting has to unget a variable number of code units -- whereas peeking can compute that number of code units and then use it directly when the peeked code point is consumed, avoiding double-computation and increased potential for error.) r=arai
735ee4ba2523472561514447de4e7558efae9e1b
created 2018-07-17 21:13 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Move TokenStreamChars::getFullAsciiCodePoint to GeneralTokenStreamChars::getFullAsciiCodePoint, because its algorithm is identical for UTF-8 and UTF-16. r=arai
7da01c72860d3461d177fc3a07cbb8f0b51e6c27
created 2018-07-17 21:00 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Replace SourceUnits<CharT>::isRawEOLChar (where CharT had rather uncertain meaning) with standalone IsLineTerminator of clearer meaning. r=arai
670d911efa814f0b6f042bdf859abf666e4d510a
created 2018-07-17 21:01 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Implement TokenStreamCharsBase::addLineOfContext that does all the work of creating a syntax-error window and works for either CharT. r=arai
30c6932eea32e4b49abb30f20b1e49c804734731
created 2018-07-13 18:59 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Move error-message window-start computation into SourceUnits::findWindowStart so that specialized versions can be provided for UTF-8 and UTF-16. r=arai
ff1852065b5c6a4f2a1829b290f91dae26f7804f
created 2018-07-10 12:06 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Rename SourceUnits::findEOLMax to SourceUnits::findWindowEnd, and make it include only valid UTF-16. r=arai
6ac4c8ad6b9a20ba54462a2e877c594df8767401
created 2018-07-18 18:05 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Move TokenStreamSpecific::computeLineOfContext to GeneralTokenStreamChars::internalComputeLineOfContext, and beef up its doc comment a little. r=arai
96e6f8645b7c00eb4bd9eab952c2c24ab1ed9ec2
created 2018-07-09 16:11 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Implement a bare-bones TokenStreamChars specialization for UTF-8, into which subsequent UTF-8-centric functions can be added. r=arai
7d07cfa666bf8bb2ec9aef3c7f88654f66e9a433
created 2018-06-29 13:46 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Move fillCharBufferWithTemplateStringContents into TokenStreamCharsBase so that a UTF-8 specialization can eventually be defined for it. r=arai
4bd4c0e74bc6ce7ef610ef902085a3609b9517f8
created 2018-07-17 21:00 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Make matchCodeUnit only accept ASCII, and split matchLineTerminator (for '\r' and '\n') out of it. r=arai
80b3a14e84c23a7215243376d1a3143a985aee8a
created 2018-07-09 16:22 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Remove ungetLineTerminator, used only to unget Unicode separators, and replace it with a SourceUnits::ungetLineOrParagraphSeparator. r=arai
3a4e6ae59b597084afaed1d84d1674ee556406d5
created 2018-07-09 14:38 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Add a getNonAsciiCodePointDontNormalize for use in situations that demand such. r=arai
44b64b5a44fcfdaf086bd32b7c8038efac5bf652
created 2018-06-29 13:46 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Move consumeRestOfSingleLineComment into TokenStreamChars (and the infallible UTF-16 implementation into SpecializedTokenStreamCharsBase) so that it can be easily specialized for UTF-8. r=arai
9ed1d40847424b11e2bc6b5cbc7e497753c81938
created 2018-07-06 17:12 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Add a SpecializedTokenStreamCharsBase class to the hierarchy as a clear collection point for functions entirely specific to UTF-8 or UTF-16 tokenizing only. r=arai
1b604df36960311748f612b3dd01597938977d77
created 2018-07-17 21:00 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1476866 - Fix the TokenStreamChars::getNonAsciiCodePoint doc comment to be clearer about |lead| being non-ASCII but still potentially (for UTF-16) a full code point. r=arai
1031a09274e0bc148e11f0dae2426e64e107c69a
created 2018-06-28 20:18 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1472066 - Define UTF-8-specific versions of certain tokenizing helper functions, complementing the existing UTF-16 versions. r=arai
25d29385236c0062dc73e2b7199de1dc40d702e0
created 2018-07-02 19:16 -0700
pushed 2018-08-24 17:49 +0000
Jeff Walden Jeff Walden - Bug 1472569 - |this->|-qualify a bunch of function calls on |using Base::foo| members that gcc 8 completely chokes on and grossly misunderstands. r=arai
less more (0) -300 -100 -60 tip