Question: is it possible to hide the objectify stuff somehow ?
Thing is, it makes the tokenizer creation and use over complicated. The topic “serial communication” isn’t an easy one but stuff like this scares a lot of ppl (namely students). They need to understand the tokenizer, the different versions and then adding weird regions to it.
I’d argue in 99% of cases you don’t need this parameter visible. At least everytime i used the tokenizer i didnt need it.
But i’m happy to learn why it is there, maybe there is a reason i don’t get. Different design approaches ? I’d make the nodes as common as possible rather than including every special case.