09-20-2014, 02:20 PM
Is it possible to not eliminate special characters that go with the words when tokenizing? Like this example:
Macro Macro248
I would like to see that those words still exist after tokenizing:
balloons:
"red"
"blue"
#1
#2
80%
AbcDef@yahoo.com
$20"^-^
Black&Decker
Macro Macro248
str s=
;I have 2 balloons: one is "red" and one is "blue". My brother has 2 cars. Car #1 is white and car #2 is grey.
;
;I complete 80% of my homework. My email is AbcDef@yahoo.com. I have one $20 bill in my wallet ^-^.
;
;I have a Black&Decker power drill tool.balloons:
"red"
"blue"
#1
#2
80%
AbcDef@yahoo.com
$20"^-^
Black&Decker
