org.intellij.lang.jflex.lexer._JFlexLexer.advance(_JFlexLexer.java:745)

[GoogleCodeExporter]

What steps will reproduce the problem?
1. open IDEA project
2. start/force reindexing
3. breaks at several .flex files, see example below

What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?


Please provide any additional information below.

Error while indexing 
/Users/yann/idea-ultimate/IDEA/community/tools/lexer/jflex-1.4/examples/java/jav
a.flex
To reindex this file IDEA has to be restarted: 2482
java.lang.ArrayIndexOutOfBoundsException: 2482
    at com.intellij.util.text.CharArrayCharSequence.charAt(CharArrayCharSequence.java:48)
    at org.intellij.lang.jflex.lexer._JFlexLexer.advance(_JFlexLexer.java:745)
    at com.intellij.lexer.FlexAdapter.locateToken(FlexAdapter.java:93)
    at com.intellij.lexer.FlexAdapter.getTokenType(FlexAdapter.java:57)
    at com.intellij.lexer.MergingLexerAdapter$1.merge(MergingLexerAdapter.java:31)
    at com.intellij.lexer.MergingLexerAdapterBase.locateToken(MergingLexerAdapterBase.java:75)
    at com.intellij.lexer.MergingLexerAdapterBase.getTokenType(MergingLexerAdapterBase.java:45)
    at com.intellij.openapi.editor.ex.util.LexerEditorHighlighter.a(LexerEditorHighlighter.java:311)
    at com.intellij.openapi.editor.ex.util.LexerEditorHighlighter.setText(LexerEditorHighlighter.java:292)
    at com.intellij.psi.impl.cache.impl.id.PlatformIdTableBuilding$TokenSetTodoIndexer.map(PlatformIdTableBuilding.java:167)
    at com.intellij.psi.impl.cache.impl.id.PlatformIdTableBuilding$TokenSetTodoIndexer.map(PlatformIdTableBuilding.java:144)
    at com.intellij.psi.impl.cache.impl.todo.TodoIndex$4.map(TodoIndex.java:108)
    at com.intellij.psi.impl.cache.impl.todo.TodoIndex$4.map(TodoIndex.java:100)
    at com.intellij.util.indexing.MapReduceIndex.update(MapReduceIndex.java:215)
    at com.intellij.util.indexing.FileBasedIndexImpl$24.run(FileBasedIndexImpl.java:1654)
    at com.intellij.openapi.progress.impl.ProgressManagerImpl.executeNonCancelableSection(ProgressManagerImpl.java:136)
    at com.intellij.util.indexing.FileBasedIndexImpl.a(FileBasedIndexImpl.java:1650)
    at com.intellij.util.indexing.FileBasedIndexImpl.indexFileContent(FileBasedIndexImpl.java:1613)
    at com.intellij.util.indexing.UnindexedFilesUpdater.processFile(UnindexedFilesUpdater.java:64)
    at com.intellij.openapi.project.CacheUpdateSession.processFile(CacheUpdateSession.java:102)
    at com.intellij.openapi.project.CacheUpdateRunner$MyRunnable$1.run(CacheUpdateRunner.java:228)
    at com.intellij.openapi.application.impl.ApplicationImpl.runReadAction(ApplicationImpl.java:918)
    at com.intellij.openapi.project.CacheUpdateRunner$MyRunnable.run(CacheUpdateRunner.java:232)
    at com.intellij.openapi.application.impl.ApplicationImpl$6.run(ApplicationImpl.java:457)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:680)
    at com.intellij.openapi.application.impl.ApplicationImpl$1$1.run(ApplicationImpl.java:148)

Original issue reported on code.google.com by yann.ceb...@gmail.com on 30 May 2012 at 12:10