 |
AppletTalk.com
Java discussions newsgroups
|
| View previous topic :: View next topic |
| Author |
Message |
gajo
Guest
|
 Posted: Wed Jun 23, 2004 4:15 pm Post subject: StringTokenizer troubles |
 |
|
Hi!
I'm interested if there is a simple way of doing the following: I have a
structure of data, let's say String A, String B and String C. The user can
fill out all three with some data, but he doesn't have to, so in that case
that string will remain empty (""). Now after the user clicks on "Save", the
data is saved to a file, delimited by a string of signs, let's say *#$. So,
a usual line would look like this:
tree*#$mountain*#$apple A=tree, B=mountain, C=apple
lion*#$*#$monkey A=lion, B="", C=monkey
*#$*#$*#$ A = B = C = ""
Then I try to read this back from the file, and using the StringTokenizer I
split a line into tokens. The trouble is that the StringTokenizer doesn't
read the empty strings, but instead jumps over them, so for example where I
had lion*#$*#$monkey A=lion, B="", C=monkey, after reading it back I will
get A=lion, B=monkey, C=<an exception will occur, no more tokens>.
Is there a way for me to do it in a simple way that the StringTokenizer does
read the empty strings? I could of course split the string with
StringTokenizer(someString, true), but then I have to check if a token is *,
# or $, or something else, how many lines do I have to read more, is it the
end of the line etc. or in other words I wouldn't have to use the
StringTokenizer at all!
Gajo
|
|
| Back to top |
|
 |
Steve Horsley
Guest
|
| Posted: Wed Jun 23, 2004 5:31 pm Post subject: Re: StringTokenizer troubles |
|
|
gajo wrote:
| Quote: | Hi!
I'm interested if there is a simple way of doing the following: I have a
structure of data, let's say String A, String B and String C. The user can
fill out all three with some data, but he doesn't have to, so in that case
that string will remain empty (""). Now after the user clicks on "Save", the
data is saved to a file, delimited by a string of signs, let's say *#$. So,
a usual line would look like this:
tree*#$mountain*#$apple A=tree, B=mountain, C=apple
lion*#$*#$monkey A=lion, B="", C=monkey
*#$*#$*#$ A = B = C = ""
Then I try to read this back from the file, and using the StringTokenizer I
split a line into tokens. The trouble is that the StringTokenizer doesn't
read the empty strings, but instead jumps over them, so for example where I
had lion*#$*#$monkey A=lion, B="", C=monkey, after reading it back I will
get A=lion, B=monkey, C=<an exception will occur, no more tokens>.
Is there a way for me to do it in a simple way that the StringTokenizer does
read the empty strings? I could of course split the string with
StringTokenizer(someString, true), but then I have to check if a token is *,
# or $, or something else, how many lines do I have to read more, is it the
end of the line etc. or in other words I wouldn't have to use the
StringTokenizer at all!
Gajo
You are right - string tokenizer omits blank fields (unless you tell it to |
also return the separators). Another thing - the separator that you give
to the constructor (StringTokenizer(myString, "*#$")) provides a LIST of
ALTERNATIVE separator CHARACTERS, not a multiple-character separator String.
So "*#$" says any one of those three characters could be a separator.
So StringTokenizer won't do what you want.
Either roll your own string splitter (not hard) or use the regular
expression package that was introduced with (IIRC) java 1.3.
Steve
|
|
| Back to top |
|
|
Roedy Green
Guest
|
| Posted: Wed Jun 23, 2004 7:04 pm Post subject: Re: StringTokenizer troubles |
|
|
On Wed, 23 Jun 2004 18:31:07 +0100, Steve Horsley <shoot (AT) the (DOT) moon>
wrote or quoted :
| Quote: | So StringTokenizer won't do what you want.
Either roll your own string splitter (not hard) or use the regular
expression package that was introduced with (IIRC) java 1.3.
|
see http://mindprod.com/jgloss/regex.html
for how to use split to break your line into tokens and get back even
the null fields.
--
Canadian Mind Products, Roedy Green.
Coaching, problem solving, economical contract programming.
See http://mindprod.com/jgloss/jgloss.html for The Java Glossary.
|
|
| Back to top |
|
|
Oscar kind
Guest
|
| Posted: Wed Jun 23, 2004 7:12 pm Post subject: Re: StringTokenizer troubles |
|
|
gajo <gajo (AT) eunet (DOT) yu> wrote:
| Quote: | I'm interested if there is a simple way of doing the following: I have a
structure of data, let's say String A, String B and String C. The user can
fill out all three with some data, but he doesn't have to, so in that case
that string will remain empty (""). Now after the user clicks on "Save", the
data is saved to a file, delimited by a string of signs, let's say *#$. So,
a usual line would look like this:
tree*#$mountain*#$apple A=tree, B=mountain, C=apple
lion*#$*#$monkey A=lion, B="", C=monkey
*#$*#$*#$ A = B = C = ""
|
You'll run into problems with StringTokenizer, because it only uses single
characters as delimiters. See the API docs for more details.
A better way to write the strings is in CSV format. See:
http://www.csc.liv.ac.uk/~sphelps/jasa/
Specifically, check the API for these classes:
uk.ac.liv.util.io.CSVReader
uk.ac.liv.util.io.CSVWriter
mvg,
Oscar
--
Oscar Kind http://home.hccnet.nl/okind/
Software Developer for contact information, see website
PGP Key fingerprint: 91F3 6C72 F465 5E98 C246 61D9 2C32 8E24 097B B4E2
|
|
| Back to top |
|
|
V S Rawat
Guest
|
| Posted: Wed Jun 23, 2004 7:41 pm Post subject: Re: StringTokenizer troubles |
|
|
gajo wrote:
| Quote: | Hi! I'm interested if there is a simple way of doing the
following: I have a structure of data, let's say String
A, String B and String C. The user can fill out all three
with some data, but he doesn't have to, so in that case
that string will remain empty (""). Now after the user
clicks on "Save", the data is saved to a file, delimited
by a string of signs, let's say *#$. So, a usual line
would look like this: tree*#$mountain*#$apple A=tree,
B=mountain, C=apple lion*#$*#$monkey A=lion, B="",
C=monkey *#$*#$*#$ A = B = C = ""
Then I try to read this back from the file, and using the
StringTokenizer I split a line into tokens. The trouble
is that the StringTokenizer doesn't read the empty
strings, but instead jumps over them, so for example
where I had lion*#$*#$monkey A=lion, B="", C=monkey,
after reading it back I will get A=lion, B=monkey, C=<an
exception will occur, no more tokens>. Is there a way for
me to do it in a simple way that the StringTokenizer does
read the empty strings? I could of course split the
string with StringTokenizer(someString, true), but then I
have to check if a token is *, # or $, or something else,
how many lines do I have to read more, is it the end of
the line etc. or in other words I wouldn't have to use
the StringTokenizer at all!
|
hope it helps.
-Rawat
import java.util.*;
class Token3 {
public static void main(String args[]) {
String[] input = { "*#$tree*#$mountain*#$apple*#$",
"*#$lion*#$*#$monkey*#$" };
String[][] the_tokens = new String[2][3];
String token = "*#$";
int len;
for (int j = 0; j < 2; j++) {
StringTokenizer t = new
StringTokenizer(input[j],token);
int number = t.countTokens();
len = 0;
for (int i = 0; i < 3; i++) {
if
(input[j].substring(len+3,len+6).equals(token)) {
the_tokens[j][i] = "";
}
else {
the_tokens[j][i] = t.nextToken();
}
len = len + the_tokens[j][i].length() + 3;
System.out.println(j + "," + i + ": " +
the_tokens[j][i]);
}
}
} // main
}
|
|
| Back to top |
|
|
gajo
Guest
|
| Posted: Wed Jun 23, 2004 8:56 pm Post subject: Re: StringTokenizer troubles |
|
|
Hey, thanks for the effort, unfortunately I took Steve's advice a few hours
ago and wrote my own parser, which works fine :)
|
|
| Back to top |
|
|
gajo
Guest
|
| Posted: Wed Jun 23, 2004 8:58 pm Post subject: Re: StringTokenizer troubles |
|
|
"Steve Horsley" <shoot (AT) the (DOT) moon> wrote
| Quote: | So StringTokenizer won't do what you want.
Either roll your own string splitter (not hard) or use the regular
expression package that was introduced with (IIRC) java 1.3.
Steve
|
I know it's not hard, but I was wondering if there was a built-in function.
Anyway, I wrote my own class after.
What is this regular expression package you are talking about?
|
|
| Back to top |
|
|
V S Rawat
Guest
|
| Posted: Thu Jun 24, 2004 3:10 am Post subject: Re: StringTokenizer troubles |
|
|
gajo wrote:
| Quote: | Hey, thanks for the effort, unfortunately I took Steve's advice a few hours
ago and wrote my own parser, which works fine 
|
not fair.
when you post a query you should have given some time for
people to respond.
never mind. just kidding. :)
why not post that parser how you tackled it.
-Rawat
|
|
| Back to top |
|
|
gajo
Guest
|
| Posted: Thu Jun 24, 2004 5:23 am Post subject: Re: StringTokenizer troubles |
|
|
"V S Rawat" <vsrawat_no_reply_ (AT) hclinfinet (DOT) com> wrote
| Quote: | why not post that parser how you tackled it.
-Rawat
|
I think I should throw out the exception throwing part in the constructor.
It gave me a lot of troubles because I had to put the whole code in a try
block, and my program ignored all errors and I had a hard time to debug it.
This is the code. You create a parser with new MyParser(String,delimiter),
where delimiter can be any string.
public class MyParser { // my forgery of StringTokenizer
private String[] parts;
private int numParts = 0;
private int indeks = 0;
public MyParser(String s, String delimiter) throws Exception {
if (s == null) {
throw new Exception("String is empty!");
} else {
int nbr = 0;
int from = 0;
int rez = 0;
while (rez != -1) {
rez = s.indexOf(delimiter,from);
if (rez == -1) {
nbr++;
break;
}
nbr++;
from = rez+1;
}
numParts = nbr;
parts = new String[nbr];
rez = 0;
from = 0;
nbr = 0;
while (rez != -1) {
int tmp=-1;
if (rez == 0) {
tmp = rez;
} else {
tmp = rez + delimiter.length();
}
rez = s.indexOf(delimiter,from);
if (rez == -1) {
parts[nbr] = s.substring(tmp,s.length());
break;
}
parts[nbr] = s.substring(tmp,rez);
nbr++;
from = rez+1;
}
}
}
public String next() {
try {
indeks++;
return parts[indeks-1];
} catch (Exception e) {
indeks--;
return parts[indeks];
}
}
public String first() {
indeks = 0;
return parts[0];
}
public String prev() {
try {
indeks--;
return parts[indeks+1];
} catch (Exception e) {
indeks++;
return parts[indeks];
}
}
public String last() {
indeks = parts.length-1;
return parts[indeks];
}
public int numParts() {
return numParts;
}
public boolean hasMore() {
return indeks != parts.length;
}
} // end of class
|
|
| Back to top |
|
|
Adam
Guest
|
| Posted: Thu Jun 24, 2004 7:01 am Post subject: Re: StringTokenizer troubles |
|
|
"gajo" <gajo (AT) eunet (DOT) yu> wrote
| Quote: | "Steve Horsley" <shoot (AT) the (DOT) moon> wrote in message
news:cbcenn$9n$1 (AT) news (DOT) freedom2surf.net...
So StringTokenizer won't do what you want.
Either roll your own string splitter (not hard) or use the regular
expression package that was introduced with (IIRC) java 1.3.
Steve
I know it's not hard, but I was wondering if there was a built-in
function.
Anyway, I wrote my own class after.
What is this regular expression package you are talking about?
|
@since java 1.4
java.utils.regex
But for your needs it would be enough to look at String.split(String
regex) method.
You could have a single line of code instead of the parser you had to
write,
same happened to me :)
Adam
|
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
