Tokenizer.java
| Index Score | ||
|---|---|---|
 |
 |
org.hsqldb |
 |
|
HSQL Database Engine |
View: Reasons, Metrics, Source Code
These are the metrics that contribute to the Enerjy Score for this file, ranked by impact. So the metrics listed at the top influence the score to a greater extent that the metrics listed at the bottom.
| Metric | Description | |
|---|---|---|
| CYCLOMATIC | Cyclomatic complexity |  |
| RETURNS | Number of return points from functions | |
| LINE_COMMENT | Number of line comments | |
| DECL_COMMENTS | Comments in declarations | |
| SIZE | Size of the file in bytes | |
| LINES | Number of lines in the source file | |
| ELOC | Effective lines of code | |
| WHITESPACE | Number of whitespace lines | |
| JAVA0031 | JAVA0031 Case statement not properly closed | |
| LOGICAL_LINES | Number of statements | |
| LOC | Lines of code | |
| COMPARISONS | Number of comparison operators | |
| BLOCKS | Number of blocks | |
| EXEC_COMMENTS | Comments in executable code | |
| INTERFACE_COMPLEXITY | Interface complexity | |
| OPERATORS | Number of operators | |
| PROGRAM_LENGTH | Halstead program length | |
| OPERANDS | Number of operands | |
| COMMENTS | Comment lines | |
| JAVA0034 | JAVA0034 Missing braces in if statement | |
| JAVA0166 | JAVA0166 Generic exception caught | |
| FUNCTIONS | Number of function declarations | |
| JAVA0040 | JAVA0040 Switch statement contains N cases (maximum: M) | |
| UNIQUE_OPERATORS | Number of unique operators | |
| PROGRAM_VOCAB | Halstead program vocabulary | |
| EXITS | Procedure exits | |
| UNIQUE_OPERANDS | Number of unique operands | |
| JAVA0008 | JAVA0008 Empty catch block | |
| JAVA0119 | JAVA0119 Control variable changed within body of for loop | |
| PROGRAM_VOLUME | Halstead program volume | |
| JAVA0136 | JAVA0136 N methods defined in class (maximum: M) | |
| BLOCK_COMMENT | Number of block comment lines | |
| JAVA0032 | JAVA0032 Switch statement missing default | |
| JAVA0174 | JAVA0174 Assigned local variable never used | |
| JAVA0160 | JAVA0160 Method does not throw specified exception | |
| JAVA0126 | JAVA0126 Method declares unchecked exception in throws | |
| JAVA0110 | JAVA0110 Incorrect javadoc: no @return tag | |
| DOC_COMMENT | Number of javadoc comment lines | |
| JAVA0123 | JAVA0123 Use all three components of for loop | |
| JAVA0100 | JAVA0100 Class contains N non-final fields (maximum: M) | |
| JAVA0108 | JAVA0108 Incorrect javadoc: no @param tag for 'parameter' | |
| NEST_DEPTH | Maximum nesting depth | |
| JAVA0145 | JAVA0145 Tab character used in source file | |
/* Copyright (c) 1995-2000, The Hypersonic SQL Group.
* All rights reserved.
*
* Redistribution and use in source and binary forms, with or without
* modification, are permitted provided that the following conditions are met:
*
* Redistributions of source code must retain the above copyright notice, this
* list of conditions and the following disclaimer.
*
* Redistributions in binary form must reproduce the above copyright notice,
* this list of conditions and the following disclaimer in the documentation
* and/or other materials provided with the distribution.
*
* Neither the name of the Hypersonic SQL Group nor the names of its
* contributors may be used to endorse or promote products derived from this
* software without specific prior written permission.
*
* THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
* ARE DISCLAIMED. IN NO EVENT SHALL THE HYPERSONIC SQL GROUP,
* OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
* EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
* PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
* LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
* ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
* (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
* SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
*
* This software consists of voluntary contributions made by many individuals
* on behalf of the Hypersonic SQL Group.
*
*
* For work added by the HSQL Development Group:
*
* Copyright (c) 2001-2007, The HSQL Development Group
* All rights reserved.
*
* Redistribution and use in source and binary forms, with or without
* modification, are permitted provided that the following conditions are met:
*
* Redistributions of source code must retain the above copyright notice, this
* list of conditions and the following disclaimer.
*
* Redistributions in binary form must reproduce the above copyright notice,
* this list of conditions and the following disclaimer in the documentation
* and/or other materials provided with the distribution.
*
* Neither the name of the HSQL Development Group nor the names of its
* contributors may be used to endorse or promote products derived from this
* software without specific prior written permission.
*
* THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
* ARE DISCLAIMED. IN NO EVENT SHALL HSQL DEVELOPMENT GROUP, HSQLDB.ORG,
* OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
* EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
* PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
* LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
* ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
* (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
* SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
*/
package org.hsqldb;
import java.io.IOException;
import java.math.BigDecimal;
import java.util.Locale;
import org.hsqldb.lib.IntValueHashMap;
import org.hsqldb.lib.StringConverter;
import org.hsqldb.lib.java.JavaSystem;
import org.hsqldb.store.BitMap;
import org.hsqldb.store.ValuePool;
import org.hsqldb.types.BinaryData;
// fredt@users 20020218 - patch 455785 by hjbusch@users - large DECIMAL inserts
// also Long.MIM_VALUE (bug 473388) inserts - applied to different parts
// fredt@users 20020408 - patch 1.7.0 by fredt - exact integral types
// integral values are cast into the smallest type that can hold them
// fredt@users 20020501 - patch 550970 by boucherb@users - fewer StringBuffers
// fredt@users 20020611 - patch 1.7.0 by fredt - correct statement logging
// changes to the working of getLastPart() to return the correct statement for
// logging in the .script file.
// also restructuring to reduce use of objects and speed up tokenising of
// strings and quoted identifiers
// fredt@users 20021112 - patch 1.7.2 by Nitin Chauhan - use of switch
// rewrite of the majority of multiple if(){}else{} chains with switch(){}
// fredt@users 20030610 - patch 1.7.2 - no StringBuffers
// blaine / fred - three part identifier support
/**
* Provides the ability to tokenize SQL character sequences.
*
* Extensively rewritten and extended in successive versions of HSQLDB.
*
* @author Thomas Mueller (Hypersonic SQL Group)
* @version 1.9.0
* @since Hypersonic SQL
*/
public class Tokenizer {
private static final int NO_TYPE = Types.SQL_TYPE_NUMBER_LIMIT + 1,
NAME = Types.SQL_TYPE_NUMBER_LIMIT + 2,
LONG_NAME = Types.SQL_TYPE_NUMBER_LIMIT + 3,
SPECIAL = Types.SQL_TYPE_NUMBER_LIMIT + 4,
QUOTED_NAME = Types.SQL_TYPE_NUMBER_LIMIT + 5,
REMARK_LINE = Types.SQL_TYPE_NUMBER_LIMIT + 6,
REMARK = Types.SQL_TYPE_NUMBER_LIMIT + 7;
private String sCommand;
private int iLength;
private int iIndex;
private int tokenIndex;
private int nextTokenIndex;
private int beginIndex;
private int iType = NO_TYPE;
private String sToken;
// Qualifiers are object name qualifiers like in
// "qualifier1.qualier2.objectname"
private String namePrefix = null;
private String namePrePrefix = null;
private boolean recursing = false;
// WAIT. Don't do anything before popping another Token (because the
// state variables aren't set properly due to a call of wait()).
private boolean bWait;
private boolean lastTokenQuotedID;
// literals that are values
static IntValueHashMap valueTokens;
static {
valueTokens = new IntValueHashMap();
valueTokens.put(Token.T_NULL, Types.SQL_ALL_TYPES);
valueTokens.put(Token.T_TRUE, Types.SQL_BOOLEAN);
valueTokens.put(Token.T_FALSE, Types.SQL_BOOLEAN);
}
public Tokenizer() {}
public Tokenizer(String s) {
sCommand = s;
iLength = s.length();
iIndex = 0;
}
public void reset(String s) {
sCommand = s;
iLength = s.length();
iIndex = 0;
tokenIndex = 0;
nextTokenIndex = 0;
beginIndex = 0;
iType = NO_TYPE;
sToken = null;
namePrefix = null;
namePrePrefix = null;
bWait = false;
lastTokenQuotedID = false;
recursing = false;
}
/**
*
*/
void back() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
nextTokenIndex = iIndex;
iIndex = tokenIndex;
bWait = true;
}
void position(int pos) {
iIndex = pos;
bWait = false;
}
/**
* get the given token or throw for commands and simple unquoted identifiers
* only
*
* @param match String
* @throws HsqlException
* @return String
*/
String getThis(String match) throws HsqlException {
getToken();
matchThis(match);
return sToken;
}
/**
* for commands and simple unquoted identifiers only
*
* @param match String
* @throws HsqlException
*/
void matchThis(String match) throws HsqlException {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
if (!sToken.equals(match) || iType == QUOTED_NAME
|| iType == LONG_NAME) {
// match is a single token - when no match, we report the first
// unmatched token as the unexpected token
String token = namePrePrefix != null ? namePrePrefix
: namePrefix != null
? namePrefix
: sToken;
throw Trace.error(Trace.UNEXPECTED_TOKEN, Trace.TOKEN_REQUIRED,
new Object[] {
token, match
});
}
}
/**
* Used for commands only
*
* @param match String
* @return boolean
*/
public boolean isGetThis(String match) throws HsqlException {
getToken();
if (iType != QUOTED_NAME && iType != LONG_NAME
&& sToken.equals(match)) {
return true;
}
back();
return false;
}
boolean wasSpecial() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
return iType == SPECIAL;
}
/**
* this methode is called before other wasXXX methods and takes precedence
*
* @return boolean
*/
boolean wasValue() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
switch (iType) {
case Types.SQL_VARBINARY :
case Types.SQL_BIT :
case Types.SQL_CHAR :
case Types.SQL_INTEGER :
case Types.SQL_BIGINT :
case Types.SQL_DOUBLE :
case Types.SQL_NUMERIC :
case Types.SQL_BOOLEAN :
case Types.SQL_ALL_TYPES :
return true;
default :
return false;
}
}
boolean wasQuotedIdentifier() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
return lastTokenQuotedID;
}
/**
* Method declaration
*
* @return boolean
*/
boolean wasLongName() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
return iType == LONG_NAME;
}
/**
* Simple Name means a quoted or unquoted identifier without qualifiers
* provided it is not in the hKeyword list.
*
* @return boolean
* @throws HsqlException
*/
boolean wasSimpleName() {
if (bWait) {
throw Trace.runtimeError(Trace.UNSUPPORTED_INTERNAL_OPERATION,
"Querying state when in Wait mode");
}
if (iType == NAME || (iType == QUOTED_NAME && sToken.length() != 0)) {
return true;
}
return false;
}
boolean wasNameOrKeyword() throws HsqlException {
if (bWait) {
throw Trace.runtimeError(Trace.UNSUPPORTED_INTERNAL_OPERATION,
"Querying state when in Wait mode");
}
return (iType == NAME || iType == QUOTED_NAME || iType == LONG_NAME);
}
/**
* Return first part of long name.
*
* @return String prefix
*/
String getNamePrefix() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
return namePrefix;
}
/**
* Return second part of long name
*
* @return String pre-prefix
*/
String getNamePrePrefix() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
return namePrePrefix;
}
boolean wasSimpleToken() {
if (bWait) {
throw Trace.runtimeError(Trace.UNSUPPORTED_INTERNAL_OPERATION,
"Querying state when in Wait mode");
}
return iType != QUOTED_NAME && iType != LONG_NAME
&& iType != Types.SQL_CHAR;
}
String getSimpleToken() throws HsqlException {
getToken();
if (iType == QUOTED_NAME || iType == LONG_NAME
|| iType == Types.SQL_CHAR) {
String token = iType == LONG_NAME ? namePrefix
: sToken;
throw Trace.error(Trace.UNEXPECTED_TOKEN, token);
}
return sToken;
}
public boolean wasThis(String match) {
if (sToken.equals(match) && iType != QUOTED_NAME && iType != LONG_NAME
&& iType != Types.SQL_CHAR) {
return true;
}
return false;
}
/**
* getName() is more broad than getSimpleName() in that it includes
* 2-part names as well
*
* @return popped name
* @throws HsqlException if next token is not an AName
*/
String getName() throws HsqlException {
getToken();
if (!wasNameOrKeyword()) {
throw Trace.error(Trace.UNEXPECTED_TOKEN, sToken);
}
return sToken;
}
/**
* Returns a single, unqualified name (identifier)
*
* @return name
* @throws HsqlException
*/
public String getSimpleName() throws HsqlException {
getToken();
if (!wasSimpleName()) {
String token = iType == LONG_NAME ? namePrefix
: sToken;
throw Trace.error(Trace.UNEXPECTED_TOKEN, token);
}
return sToken;
}
/**
* Return any token.
*
* @return token
* @throws HsqlException
*/
public String getString() throws HsqlException {
getToken();
return sToken;
}
int getInt() throws HsqlException {
long v = getBigint();
if (v > Integer.MAX_VALUE || v < Integer.MIN_VALUE) {
throw Trace.error(Trace.NUMERIC_VALUE_OUT_OF_RANGE);
}
return (int) v;
}
static BigDecimal LONG_MAX_VALUE_INCREMENT =
BigDecimal.valueOf(Long.MAX_VALUE).add(BigDecimal.valueOf(1));
long getBigint() throws HsqlException {
boolean minus = false;
getToken();
if (sToken.equals(Token.T_MINUS)) {
minus = true;
getToken();
}
Object o = getAsValue();
int t = getType();
switch (t) {
case Types.SQL_INTEGER :
case Types.SQL_BIGINT :
break;
case Types.SQL_NUMERIC :
// only Long.MAX_VALUE + 1 together with minus is acceptable
if (minus && LONG_MAX_VALUE_INCREMENT.equals(o)) {
return Long.MIN_VALUE;
}
default :
throw Trace.error(Trace.WRONG_DATA_TYPE);
}
long v = ((Number) o).longValue();
return minus ? -v
: v;
}
Object getInType(int type) throws HsqlException {
getToken();
Object o = getAsValue();
int t = getType();
if (t != type) {
throw Trace.error(Trace.WRONG_DATA_TYPE);
}
return o;
}
/**
*
* @return data type
* @throws HsqlException
*/
public int getType() {
if (bWait) {
Trace.doAssert(false, "Querying state when in Wait mode");
}
// todo: make sure it's used only for Values!
// todo: synchronize iType with hColumn
switch (iType) {
case Types.SQL_CHAR :
case Types.SQL_INTEGER :
case Types.SQL_BIGINT :
case Types.SQL_DOUBLE :
case Types.SQL_NUMERIC :
case Types.SQL_VARBINARY :
case Types.SQL_BIT :
case Types.SQL_BOOLEAN :
return iType;
default :
return Types.SQL_ALL_TYPES;
}
}
/**
* Method declaration
*
* @return value Object
* @throws HsqlException
*/
Object getAsValue() throws HsqlException {
if (!wasValue()) {
throw Trace.error(Trace.UNEXPECTED_TOKEN, sToken);
}
switch (iType) {
case Types.SQL_ALL_TYPES :
return null;
case Types.SQL_CHAR :
//fredt - no longer returning string with a singlequote as last char
return sToken;
case Types.SQL_BIT : {
try {
BitMap map = StringConverter.bitToBitMap(sToken);
return new BinaryData(map.getBytes(), map.size());
} catch (IOException e) {
throw Trace.error(Trace.INVALID_CHARACTER_ENCODING,
e.toString());
}
}
case Types.SQL_VARBINARY : {
byte[] array;
try {
array = StringConverter.hexToByteArray(sToken);
return new BinaryData(array, false);
} catch (IOException e) {
throw Trace.error(Trace.INVALID_CHARACTER_ENCODING,
e.toString());
}
}
case Types.SQL_BIGINT :
return ValuePool.getLong(Long.parseLong(sToken));
case Types.SQL_INTEGER :
// fredt - this returns unsigned values which are later negated.
// as a result Integer.MIN_VALUE or Long.MIN_VALUE are promoted
// to a wider type.
if (sToken.length() < 11) {
try {
return ValuePool.getInt(Integer.parseInt(sToken));
} catch (Exception e1) {}
}
if (sToken.length() < 20) {
try {
iType = Types.SQL_BIGINT;
return ValuePool.getLong(Long.parseLong(sToken));
} catch (Exception e2) {}
}
iType = Types.SQL_NUMERIC;
return new BigDecimal(sToken);
case Types.SQL_DOUBLE :
double d = JavaSystem.parseDouble(sToken);
long l = Double.doubleToLongBits(d);
return ValuePool.getDouble(l);
case Types.SQL_NUMERIC :
return new BigDecimal(sToken);
case Types.SQL_BOOLEAN :
return sToken.equalsIgnoreCase("TRUE") ? Boolean.TRUE
: Boolean.FALSE;
default :
return sToken;
}
}
/**
* return the current position to be used for VIEW processing
*
* @return current postion
*/
int getPosition() {
return iIndex;
}
int getTokenPosition() {
return tokenIndex;
}
/**
* return part of the command String
*
* @return part of String
* @param begin int
* @param end int
*/
String getPart(int begin, int end) {
return sCommand.substring(begin, end);
}
// fredt@users 20020910 - patch 1.7.1 by Nitin Chauhan - rewrite as switch
/**
* Gets a token
*
* @throws HsqlException
*/
private void getToken() throws HsqlException {
/* Should synchronize this method, due to use of instance
* variable 'recursing'? */
/* For LONG_NAMEs, iType will be LONG_NAME. Must check
* qualifier1Type and qualifier2Type to find out the types of
* the embedded qualifiers */
if (bWait) {
bWait = false;
iIndex = nextTokenIndex;
return;
}
if (!recursing) {
// We are not recursing, so clear qualifiers
namePrefix = namePrePrefix = null;
while (iIndex < iLength
&& Character.isWhitespace(sCommand.charAt(iIndex))) {
iIndex++;
}
tokenIndex = iIndex;
}
sToken = "";
if (iIndex >= iLength) {
lastTokenQuotedID = false;
iType = NO_TYPE;
return;
}
char c = sCommand.charAt(iIndex);
boolean point = false,
digit = false,
exp = false,
afterexp = false;
boolean end = false;
char cfirst = 0;
lastTokenQuotedID = false;
if (c == 'B' || c == 'b') {
cfirst = c;
iType = Types.SQL_BIT;
} else if (c == 'X' || c == 'x') {
cfirst = c;
iType = Types.SQL_VARBINARY;
} else if (Character.isJavaIdentifierStart(c)) {
iType = NAME;
} else if (Character.isDigit(c)) {
iType = Types.SQL_INTEGER;
digit = true;
} else {
switch (c) {
case '(' :
sToken = Token.T_OPENBRACKET;
iType = SPECIAL;
iIndex++;
return;
case ')' :
sToken = Token.T_CLOSEBRACKET;
iType = SPECIAL;
iIndex++;
return;
case ',' :
sToken = Token.T_COMMA;
iType = SPECIAL;
iIndex++;
return;
case '*' :
sToken = Token.T_MULTIPLY;
iType = SPECIAL;
iIndex++;
return;
case '=' :
sToken = Token.T_EQUALS;
iType = SPECIAL;
iIndex++;
return;
case ';' :
sToken = Token.T_SEMICOLON;
iType = SPECIAL;
iIndex++;
return;
case '+' :
sToken = Token.T_PLUS;
iType = SPECIAL;
iIndex++;
return;
case '%' :
sToken = Token.T_PERCENT;
iType = SPECIAL;
iIndex++;
return;
case '?' :
sToken = Token.T_QUESTION;
iType = SPECIAL;
iIndex++;
return;
case '\"' :
lastTokenQuotedID = true;
iType = QUOTED_NAME;
iIndex++;
sToken = getString('"');
if (iIndex == sCommand.length()) {
return;
}
c = sCommand.charAt(iIndex);
if (c == '.') {
// Set another level of qualifiers
if (namePrePrefix != null) {
throw Trace.error(Trace.UNEXPECTED_TOKEN);
}
if (namePrefix != null) {
namePrePrefix = namePrefix;
}
namePrefix = sToken;
iIndex++;
// fredt - todo - avoid recursion - this has problems when there is whitespace
// after the dot - the same with NAME
// Do I need to test this condition, or is this warning obsolete?
recursing = true;
getToken();
recursing = false;
iType = LONG_NAME;
}
return;
case '\'' :
iType = Types.SQL_CHAR;
iIndex++;
sToken = getString('\'');
return;
case '!' :
case '<' :
case '>' :
case '|' :
case '/' :
case '-' :
cfirst = c;
iType = SPECIAL;
break;
case '.' :
iType = Types.SQL_NUMERIC;
point = true;
break;
default :
throw Trace.error(Trace.UNEXPECTED_TOKEN,
String.valueOf(c));
}
}
int start = iIndex++;
while (true) {
if (iIndex >= iLength) {
c = ' ';
end = true;
Trace.check(iType != Types.SQL_CHAR && iType != QUOTED_NAME,
Trace.UNEXPECTED_END_OF_COMMAND);
} else {
c = sCommand.charAt(iIndex);
}
switch (iType) {
case Types.SQL_BIT :
case Types.SQL_VARBINARY :
if (c == '\'') {
iIndex++;
sToken = getString('\'');
return;
} else {
iType = NAME;
}
case NAME :
if (Character.isJavaIdentifierPart(c)) {
break;
}
// fredt - todo new char[] to back sToken
sToken =
sCommand.substring(start,
iIndex).toUpperCase(Locale.ENGLISH);
if (c == '.') {
// Set another level of qualifiers
if (namePrePrefix != null) {
throw Trace.error(Trace.TOO_MANY_IDENTIFIER_PARTS);
}
if (namePrefix != null) {
namePrePrefix = namePrefix;
}
namePrefix = sToken;
iIndex++;
recursing = true;
getToken(); // todo: eliminate recursion
recursing = false;
iType = LONG_NAME;
} else if (c == '(') {
// it is a function call
} else {
// if in value list then it is a value
int type = valueTokens.get(sToken, -1);
if (type != -1) {
iType = type;
}
}
return;
case QUOTED_NAME :
case Types.SQL_CHAR :
// shouldn't get here
break;
case REMARK :
if (end) {
// unfinished remark
// maybe print error here
iType = NO_TYPE;
return;
} else if (c == '*') {
iIndex++;
if (iIndex < iLength
&& sCommand.charAt(iIndex) == '/') {
// using recursion here
iIndex++;
getToken();
return;
}
}
break;
case REMARK_LINE :
if (end) {
iType = NO_TYPE;
return;
} else if (c == '\r' || c == '\n') {
// using recursion here
getToken();
return;
}
break;
case SPECIAL :
if (c == '/' && cfirst == '/') {
iType = REMARK_LINE;
break;
} else if (c == '-' && cfirst == '-') {
iType = REMARK_LINE;
break;
} else if (c == '*' && cfirst == '/') {
iType = REMARK;
break;
} else if (c == '>' || c == '=' || c == '|') {
break;
}
sToken = sCommand.substring(start, iIndex);
return;
case Types.SQL_INTEGER :
case Types.SQL_DOUBLE :
case Types.SQL_NUMERIC :
if (Character.isDigit(c)) {
digit = true;
} else if (c == '.') {
iType = Types.SQL_NUMERIC;
if (point) {
throw Trace.error(Trace.UNEXPECTED_TOKEN, ".");
}
point = true;
} else if (c == 'E' || c == 'e') {
if (exp) {
throw Trace.error(Trace.UNEXPECTED_TOKEN, "E");
}
// HJB-2001-08-2001 - now we are sure it's a float
iType = Types.SQL_DOUBLE;
// first character after exp may be + or -
afterexp = true;
point = true;
exp = true;
} else if (c == '-' && afterexp) {
afterexp = false;
} else if (c == '+' && afterexp) {
afterexp = false;
} else {
afterexp = false;
if (!digit) {
if (point && start == iIndex - 1) {
sToken = ".";
iType = SPECIAL;
return;
}
throw Trace.error(Trace.UNEXPECTED_TOKEN,
String.valueOf(c));
}
sToken = sCommand.substring(start, iIndex);
return;
}
}
iIndex++;
}
}
// fredt - strings are constructed from new char[] objects to avoid slack
// because these strings might end up as part of internal data structures
// or table elements.
// we may consider using pools to avoid recreating the strings
private String getString(char quoteChar) throws HsqlException {
try {
int nextIndex = iIndex;
boolean quoteInside = false;
for (;;) {
nextIndex = sCommand.indexOf(quoteChar, nextIndex);
if (nextIndex < 0) {
throw Trace.error(Trace.UNEXPECTED_END_OF_COMMAND);
}
if (nextIndex < iLength - 1
&& sCommand.charAt(nextIndex + 1) == quoteChar) {
quoteInside = true;
nextIndex += 2;
continue;
}
break;
}
char[] chBuffer = new char[nextIndex - iIndex];
sCommand.getChars(iIndex, nextIndex, chBuffer, 0);
int j = chBuffer.length;
if (quoteInside) {
j = 0;
// fredt - loop assumes all occurences of quoteChar are paired
// this has already been checked by the preprocessing loop
for (int i = 0; i < chBuffer.length; i++, j++) {
if (chBuffer[i] == quoteChar) {
i++;
}
chBuffer[j] = chBuffer[i];
}
}
iIndex = ++nextIndex;
return new String(chBuffer, 0, j);
} catch (HsqlException e) {
throw e;
} catch (Exception e) {
e.getMessage();
}
return null;
}
/**
*
* @return length of command
*/
int getLength() {
return iLength;
}
}
The table below shows all metrics for Tokenizer.java.
| Metric | Value | Description | |
|---|---|---|---|
| BLOCKS | 123.00 | Number of blocks | |
| BLOCK_COMMENT | 69.00 | Number of block comment lines | |
| COMMENTS | 230.00 | Comment lines | |
| COMMENT_DENSITY | 0.43 | Comment density | |
| COMPARISONS | 88.00 | Number of comparison operators | |
| CYCLOMATIC | 212.00 | Cyclomatic complexity | |
| DECL_COMMENTS | 42.00 | Comments in declarations | |
| DOC_COMMENT | 110.00 | Number of javadoc comment lines | |
| ELOC | 540.00 | Effective lines of code | |
| EXEC_COMMENTS | 23.00 | Comments in executable code | |
| EXITS | 48.00 | Procedure exits | |
| FUNCTIONS | 33.00 | Number of function declarations | |
| HALSTEAD_DIFFICULTY | 134.40 | Halstead difficulty | |
| HALSTEAD_EFFORT | 0.00 | Halstead effort | |
| INTERFACE_COMPLEXITY | 127.00 | Interface complexity | |
| JAVA0001 | 0.00 | JAVA0001 Package name does not contain only lower case letters | |
| JAVA0002 | 0.00 | JAVA0002 Package name does not begin with a top level domain name or country code | |
| JAVA0003 | 0.00 | JAVA0003 Minimize use of on-demand (.*) imports | |
| JAVA0004 | 0.00 | JAVA0004 Unnecessary import from java.lang | |
| JAVA0005 | 0.00 | JAVA0005 Imports not in specified order | |
| JAVA0006 | 0.00 | JAVA0006 Empty finally block | |
| JAVA0007 | 0.00 | JAVA0007 Should not declare public field | |
| JAVA0008 | 2.00 | JAVA0008 Empty catch block | |
| JAVA0009 | 0.00 | JAVA0009 Protected member in final class | |
| JAVA0010 | 0.00 | JAVA0010 Non-instantiable class does not contain a non-private static member | |
| JAVA0011 | 0.00 | JAVA0011 Abstract class does not contain an abstract method | |
| JAVA0012 | 0.00 | JAVA0012 Non-constructor method with same name as declaring class | |
| JAVA0013 | 0.00 | JAVA0013 Non-blank final field is not static | |
| JAVA0014 | 0.00 | JAVA0014 Class with only static members has non-private constructor | |
| JAVA0015 | 0.00 | JAVA0015 Package class contains public nested type | |
| JAVA0016 | 0.00 | JAVA0016 Abstract class contains public constructor | |
| JAVA0017 | 0.00 | JAVA0017 Class name does not have required form | |
| JAVA0018 | 0.00 | JAVA0018 Method name does not have required form | |
| JAVA0019 | 0.00 | JAVA0019 Interface name does not have required form | |
| JAVA0020 | 0.00 | JAVA0020 Field name does not have required form | |
| JAVA0021 | 0.00 | JAVA0021 Interface method name does not have required form | |
| JAVA0022 | 0.00 | JAVA0022 Static final field name does not have required form | |
| JAVA0023 | 0.00 | JAVA0023 Empty finalize method | |
| JAVA0024 | 0.00 | JAVA0024 Empty class | |
| JAVA0025 | 0.00 | JAVA0025 Method override is empty | |
| JAVA0026 | 0.00 | JAVA0026 Finalize method with parameters | |
| JAVA0029 | 0.00 | JAVA0029 Private method not used | |
| JAVA0030 | 0.00 | JAVA0030 Private field not used | |
| JAVA0031 | 5.00 | JAVA0031 Case statement not properly closed | |
| JAVA0032 | 1.00 | JAVA0032 Switch statement missing default | |
| JAVA0033 | 0.00 | JAVA0033 default: not last case in switch statement | |
| JAVA0034 | 0.00 | JAVA0034 Missing braces in if statement | |
| JAVA0035 | 0.00 | JAVA0035 Missing braces in for statement | |
| JAVA0036 | 0.00 | JAVA0036 Missing braces in while statement | |
| JAVA0038 | 0.00 | JAVA0038 Non-case label in switch statement | |
| JAVA0039 | 0.00 | JAVA0039 Break statement with label | |
| JAVA0040 | 1.00 | JAVA0040 Switch statement contains N cases (maximum: M) | |
| JAVA0041 | 0.00 | JAVA0041 Nested synchronized block | |
| JAVA0042 | 0.00 | JAVA0042 Empty synchronized statement | |
| JAVA0043 | 0.00 | JAVA0043 Inner class does not use outer class | |
| JAVA0044 | 0.00 | JAVA0044 Serializable class with no instance variables | |
| JAVA0045 | 0.00 | JAVA0045 Serializable class with only transient fields | |
| JAVA0046 | 0.00 | JAVA0046 Name of class not derived from Exception ends with 'Exception' | |
| JAVA0047 | 0.00 | JAVA0047 Serializable class derives from invalid base class | |
| JAVA0048 | 0.00 | JAVA0048 Name of class derived from Exception does not end with 'Exception' | |
| JAVA0049 | 0.00 | JAVA0049 Nested block at depth N (maximum: M) | |
| JAVA0050 | 0.00 | JAVA0050 Class derives from java.lang.Error | |
| JAVA0051 | 0.00 | JAVA0051 Class derives from java.lang.RuntimeException | |
| JAVA0052 | 0.00 | JAVA0052 Class derives from java.lang.Throwable | |
| JAVA0053 | 0.00 | JAVA0053 Unused label | |
| JAVA0054 | 0.00 | JAVA0054 Inheritance depth N exceeds maximum M | |
| JAVA0055 | 0.00 | JAVA0055 Class should be interface | |
| JAVA0056 | 0.00 | JAVA0056 Unnecessary abstract modifier for interface or annotation | |
| JAVA0057 | 0.00 | JAVA0057 Unnecessary default constructor | |
| JAVA0058 | 0.00 | JAVA0058 Constructor calls super() | |
| JAVA0059 | 0.00 | JAVA0059 Method override only calls super() | |
| JAVA0061 | 0.00 | JAVA0061 Inaccessible member in anonymous class | |
| JAVA0062 | 0.00 | JAVA0062 Public class missing public member or protected constructor | |
| JAVA0063 | 0.00 | JAVA0063 Identifier name should not contain '$' | |
| JAVA0064 | 0.00 | JAVA0064 N variations of identifier name (maximum: M) | |
| JAVA0065 | 0.00 | JAVA0065 Unnecessary final modifier for method in final class | |
| JAVA0066 | 0.00 | JAVA0066 Unnecessary modifier for interface nested type | |
| JAVA0067 | 0.00 | JAVA0067 Array descriptor on identifier name | |
| JAVA0068 | 0.00 | JAVA0068 Modifiers not declared in recommended order | |
| JAVA0071 | 0.00 | JAVA0071 Strings compared with == | |
| JAVA0073 | 0.00 | JAVA0073 Integer division in floating-point context | |
| JAVA0074 | 0.00 | JAVA0074 Use of Object.notify() | |
| JAVA0075 | 0.00 | JAVA0075 Method parameter hides field | |
| JAVA0076 | 0.00 | JAVA0076 Use of magic number | |
| JAVA0077 | 0.00 | JAVA0077 Private field not used in declaring class | |
| JAVA0078 | 0.00 | JAVA0078 Floating point values compared with == | |
| JAVA0079 | 0.00 | JAVA0079 Use of instance to reference static member | |
| JAVA0080 | 0.00 | JAVA0080 Import declaration not used | |
| JAVA0081 | 0.00 | JAVA0081 Boolean literal in comparison | |
| JAVA0082 | 0.00 | JAVA0082 Unnecessary widening cast | |
| JAVA0083 | 0.00 | JAVA0083 Unnecessary instanceof test | |
| JAVA0084 | 0.00 | JAVA0084 Should use compound assignment operator | |
| JAVA0085 | 0.00 | JAVA0085 Use of sun.* class | |
| JAVA0087 | 0.00 | JAVA0087 Use of Thread.sleep() | |
| JAVA0089 | 0.00 | JAVA0089 Use of restricted package | |
| JAVA0092 | 0.00 | JAVA0092 Use of restricted type | |
| JAVA0093 | 0.00 | JAVA0093 Redundant assignment | |
| JAVA0094 | 0.00 | JAVA0094 Field hides a superclass field | |
| JAVA0095 | 0.00 | JAVA0095 Uninitialized private field | |
| JAVA0096 | 0.00 | JAVA0096 Field in nested class hides outer field | |
| JAVA0098 | 0.00 | JAVA0098 Minimize use of implicit field initializers | |
| JAVA0100 | 1.00 | JAVA0100 Class contains N non-final fields (maximum: M) | |
| JAVA0101 | 0.00 | JAVA0101 Unnecessary modifier for field in interface | |
| JAVA0102 | 0.00 | JAVA0102 Last statement in finalize() not super.finalize() | |
| JAVA0103 | 0.00 | JAVA0103 Explicit call to finalize() | |
| JAVA0104 | 0.00 | JAVA0104 finalize() only calls super.finalize() | |
| JAVA0105 | 0.00 | JAVA0105 Duplicate import declaration | |
| JAVA0106 | 0.00 | JAVA0106 Unnecessary import from current package | |
| JAVA0108 | 0.00 | JAVA0108 Incorrect javadoc: no @param tag for 'parameter' | |
| JAVA0109 | 0.00 | JAVA0109 Incorrect javadoc: no parameter 'parameter' | |
| JAVA0110 | 0.00 | JAVA0110 Incorrect javadoc: no @return tag | |
| JAVA0111 | 0.00 | JAVA0111 Incorrect javadoc: @return tag for void method | |
| JAVA0112 | 2.00 | JAVA0112 Incorrect javadoc: no exception 'exception' in throws | |
| JAVA0113 | 0.00 | JAVA0113 Incorrect javadoc: no @author tag | |
| JAVA0114 | 0.00 | JAVA0114 Incorrect javadoc: no @version tag | |
| JAVA0115 | 1.00 | JAVA0115 Incorrect javadoc: no @throws or @exception tag for 'exception' | |
| JAVA0116 | 0.00 | JAVA0116 Missing javadoc: field 'field' | |
| JAVA0117 | 4.00 | JAVA0117 Missing javadoc: method 'method' | |
| JAVA0118 | 0.00 | JAVA0118 Missing javadoc: type 'type' | |
| JAVA0119 | 1.00 | JAVA0119 Control variable changed within body of for loop | |
| JAVA0123 | 1.00 | JAVA0123 Use all three components of for loop | |
| JAVA0125 | 0.00 | JAVA0125 Continue statement with label | |
| JAVA0126 | 0.00 | JAVA0126 Method declares unchecked exception in throws | |
| JAVA0128 | 0.00 | JAVA0128 Public constructor in non-public class | |
| JAVA0130 | 0.00 | JAVA0130 Non-static method does not use instance fields | |
| JAVA0131 | 0.00 | JAVA0131 Compatible method does not override base | |
| JAVA0132 | 0.00 | JAVA0132 Method overload with compatible signature | |
| JAVA0133 | 0.00 | JAVA0133 Non-synchronized method overrides synchronized method | |
| JAVA0135 | 0.00 | JAVA0135 Only one of Object.equals and Object.hashCode defined: missing 'method' | |
| JAVA0136 | 1.00 | JAVA0136 N methods defined in class (maximum: M) | |
| JAVA0137 | 0.00 | JAVA0137 Non-abstract class missing constructor | |
| JAVA0138 | 0.00 | JAVA0138 N parameters defined for method (maximum: M) | |
| JAVA0139 | 0.00 | JAVA0139 Definition of main other than public static void main(java.lang.String[]) | |
| JAVA0141 | 0.00 | JAVA0141 Unnecessary modifier for method in interface | |
| JAVA0143 | 0.00 | JAVA0143 Synchronized method | |
| JAVA0144 | 0.00 | JAVA0144 Line exceeds maximum M characters | |
| JAVA0145 | 0.00 | JAVA0145 Tab character used in source file | |
| JAVA0150 | 0.00 | JAVA0150 java.lang.Error (or subclass) thrown | |
| JAVA0153 | 0.00 | JAVA0153 Inefficient conversion of integer to string | |
| JAVA0159 | 0.00 | JAVA0159 Inefficient conversion of string to integer | |
| JAVA0160 | 1.00 | JAVA0160 Method does not throw specified exception | |
| JAVA0161 | 0.00 | JAVA0161 Conditional wait() not in loop | |
| JAVA0163 | 0.00 | JAVA0163 Empty statement | |
| JAVA0165 | 0.00 | JAVA0165 Conflicting return statement in finally block | |
| JAVA0166 | 3.00 | JAVA0166 Generic exception caught | |
| JAVA0167 | 0.00 | JAVA0167 ThreadDeath not rethrown | |
| JAVA0169 | 0.00 | JAVA0169 Unnecessary catch block: exception 'exception' | |
| JAVA0170 | 0.00 | JAVA0170 Caught exception not derived from java.lang.Exception | |
| JAVA0171 | 0.00 | JAVA0171 Unused local variable | |
| JAVA0173 | 0.00 | JAVA0173 Unused method parameter | |
| JAVA0174 | 1.00 | JAVA0174 Assigned local variable never used | |
| JAVA0175 | 0.00 | JAVA0175 Successive assignment to variable | |
| JAVA0176 | 0.00 | JAVA0176 Local variable name does not have required form | |
| JAVA0177 | 1.00 | JAVA0177 Variable declaration missing initializer | |
| JAVA0179 | 0.00 | JAVA0179 Local variable hides visible field | |
| JAVA0233 | 0.00 | JAVA0233 Definition of serialVersionUID other than 'private static final long serialVersionUID' | |
| JAVA0234 | 0.00 | JAVA0234 Class is Serializable but does not define serialVersionUID | |
| JAVA0235 | 0.00 | JAVA0235 Class defines serialVersionUID but does not implement Serializable | |
| JAVA0236 | 0.00 | JAVA0236 Attempt to clone an object which does not implement Cloneable | |
| JAVA0237 | 0.00 | JAVA0237 Class implements Cloneable but does not have public clone method | |
| JAVA0238 | 0.00 | JAVA0238 Clone method does not call super.clone() | |
| JAVA0239 | 0.00 | JAVA0239 Class declares 'readObject' or 'writeObject' but does not implement Serializable | |
| JAVA0240 | 0.00 | JAVA0240 Serializable class which declares readObject or writeObject but not both | |
| JAVA0241 | 0.00 | JAVA0241 'readObject' or 'writeObject' should be declared private in Serializable class | |
| JAVA0242 | 0.00 | JAVA0242 Transient field in non-Serializable class | |
| JAVA0243 | 0.00 | JAVA0243 'readResolve' or 'writeReplace' should be declared private or protected | |
| JAVA0244 | 0.00 | JAVA0244 Field or method name in subclass differs only by case from inherited field or method | |
| JAVA0245 | 0.00 | JAVA0245 JUnit TestCase with non-trivial constructor | |
| JAVA0246 | 0.00 | JAVA0246 JUnit assertXXX statement missing message parameter | |
| JAVA0247 | 0.00 | JAVA0247 JUnit 'setUp()' and 'tearDown()' should call super method | |
| JAVA0248 | 0.00 | JAVA0248 JUnit method 'setUp' or 'tearDown' with incorrect signature | |
| JAVA0249 | 0.00 | JAVA0249 JUnit TestCase 'suite()' should be declared static | |
| JAVA0250 | 0.00 | JAVA0250 JUnit TestCase declares testXXX method with incorrect signature | |
| JAVA0251 | 0.00 | JAVA0251 Use '%n' for line breaks in printf/format for platform independence | |
| JAVA0252 | 0.00 | JAVA0252 'enum' is a Java 1.5 reserved word | |
| JAVA0253 | 0.00 | JAVA0253 Not all enum constants consumed in switch statement | |
| JAVA0254 | 0.00 | JAVA0254 Use enhanced for loop construct instead of Iterator | |
| JAVA0255 | 0.00 | JAVA0255 Result of method invocation not used | |
| JAVA0256 | 0.00 | JAVA0256 Assignment of external collection/array to field | |
| JAVA0257 | 0.00 | JAVA0257 Use of 'Constant Interface' anti-pattern | |
| JAVA0258 | 0.00 | JAVA0258 Implement Iterable for foreach compatibility | |
| JAVA0259 | 0.00 | JAVA0259 Return of collection/array field | |
| JAVA0260 | 0.00 | JAVA0260 Use 'enum' instead of Enumerated Type pattern | |
| JAVA0261 | 0.00 | JAVA0261 Use specialized Enum collection types | |
| JAVA0262 | 0.00 | JAVA0262 Use of char in integer context | |
| JAVA0263 | 0.00 | JAVA0263 Long literal ends with 'l' instead of 'L' | |
| JAVA0264 | 0.00 | JAVA0264 Integer math in long context - check for overflow | |
| JAVA0265 | 0.00 | JAVA0265 Use of Throwable.printStackTrace() | |
| JAVA0266 | 0.00 | JAVA0266 Use of System.out | |
| JAVA0267 | 0.00 | JAVA0267 Use of System.err | |
| JAVA0269 | 0.00 | JAVA0269 Contents of StringBuffer never used | |
| JAVA0270 | 0.00 | JAVA0270 Use Java 5.0 enhanced for loop construct to iterate over all elements in an array | |
| JAVA0271 | 0.00 | JAVA0271 Minimize use of on-demand (.*) static imports | |
| JAVA0272 | 0.00 | JAVA0272 Thread.run() called | |
| JAVA0273 | 0.00 | JAVA0273 Non-final derivative of Thread calls start() in constructor | |
| JAVA0274 | 0.00 | JAVA0274 Serializable class has a synchronized readObject() | |
| JAVA0275 | 0.00 | JAVA0275 Serializable class has a synchronized writeObject() and no other synchronized methods | |
| JAVA0276 | 0.00 | JAVA0276 Unnecessary use of String constructor | |
| JAVA0277 | 0.00 | JAVA0277 Iterator.next() implementation does not throw NoSuchElementException | |
| JAVA0278 | 0.00 | JAVA0278 Unnecessary use of Boolean constructor | |
| JAVA0279 | 0.00 | JAVA0279 Serialization method readObject or readObjectNoData calls an overridable method | |
| JAVA0280 | 0.00 | JAVA0280 IllegalMonitorStateException caught | |
| JAVA0281 | 0.00 | JAVA0281 Iterator.next() not called in loop | |
| JAVA0282 | 0.00 | JAVA0282 Call to Iterator.next() in loop which does not test Iterator.hasNext() | |
| JAVA0283 | 0.00 | JAVA0283 Control variable not updated in loop body | |
| JAVA0284 | 0.00 | JAVA0284 Explicit garbage collection | |
| JAVA0285 | 0.00 | JAVA0285 Dereference of potentially null variable | |
| JAVA0286 | 0.00 | JAVA0286 Dereference of null variable | |
| JAVA0287 | 0.00 | JAVA0287 Unnecessary null check | |
| JAVA0288 | 0.00 | JAVA0288 Inconsistent null check | |
| LINES | 1137.00 | Number of lines in the source file | |
| LINE_COMMENT | 51.00 | Number of line comments | |
| LOC | 643.00 | Lines of code | |
| LOGICAL_LINES | 315.00 | Number of statements | |
| LOOPS | 4.00 | Number of loops | |
| NEST_DEPTH | 5.00 | Maximum nesting depth | |
| OPERANDS | 1080.00 | Number of operands | |
| OPERATORS | 2169.00 | Number of operators | |
| PARAMS | 11.00 | Number of formal parameter declarations | |
| PROGRAM_LENGTH | 3249.00 | Halstead program length | |
| PROGRAM_VOCAB | 281.00 | Halstead program vocabulary | |
| PROGRAM_VOLUME | 0.00 | Halstead program volume | |
| RETURNS | 116.00 | Number of return points from functions | |
| SIZE | 32319.00 | Size of the file in bytes | |
| UNIQUE_OPERANDS | 225.00 | Number of unique operands | |
| UNIQUE_OPERATORS | 56.00 | Number of unique operators | |
| WHITESPACE | 264.00 | Number of whitespace lines | |