This change removes the call to string.Split and a few substrings, and replaces it with a tokenizer API. The tokenizer isn't really optimized right now for compute - it should probably be an iterator- but it's a significant improvement on what we're doing. |
||
|---|---|---|
| .. | ||
| PathTokenizerTest.cs | ||