Contents
This sample demonstrates a StreamBase application that processes a text log file, storing the information extracted from the log in a query table. The log file is typical of a server log: it contains information about user logins, as well as other, spurious information. The format of the log file means it is not particularly suited to direct use in an application. It does not, for example, consist of CSV records that are ready to be turned into tuples; it must be parsed first and useful information extracted. Because the log file is text and line oriented, it is well suited to parsing using regular expressions.
This example is based on the Regular Expression File Reader sample. The file
reader in that application has been replaced by a socket reader, which is
configured to connect to port 9000 on the local computer. The sample comes
with a very simple server written in Java. The source code and compiled JAR
of this server can be found in the sample's directory. The server simply
listens on port 9000 and serves the contents of a file (by default,
input.txt, though this can be specified on the
command line) at one line per second to any connections.
Note
Before the sample application is started, the file server included in the sample directory must be running.
In StreamBase Studio, import this sample with the following steps:
-
From the top menu, click → .
-
Select this sample from the Embedded Adapters list.
-
Click OK.
StreamBase Studio creates a single project containing the sample files.
By default, the sample files are installed in:
- On Windows
-
C:\Program Files\StreamBase Systems\StreamBase.n.m\sample\adapter\embedded\regexsocketreader\ - On UNIX
-
/opt/streambase/sample/adapter/embedded/regexsocketreader/
-
Launch
simpleserver.jar. The JAR can be found in theCustom Librariesdirectory in the sample directory. To do from a terminal, go to theCustom Librariesdirectory in your project and runjava -jar simpleserver.jar. -
In the Package Explorer, double-click to open the
RegexSocketReader.sbappapplication. Make sure the application is the currently active tab in the EventFlow Editor. -
Click the
Run StreamBase Application (Default Launch) button.
(Not the Run button.) This opens the
Test/Debug perspective and starts the application.
-
Select the Manual Input tab.
-
Enter
joe,fred,bob, ormaxfor Username, and press . -
The Application Output pane shows the time and IP address for the last queried user, according to the log.
-
Click → (F9).
-
In the window running simpleserver, press Ctrl-C to stop the server.
-
Change the current working directory to where the sample is installed.
-
Launch
simpleserver.jar. To do from a terminal, run.java -jar simpleserver.jar -
In another window, run
sbd RegexSocketReader.sbapp -
In another window, run
sbc dequeue Output. -
In another window, run
sbc enqueue Queries. -
In the enqueue window, type
joe,fred,bob, ormax, and press . The result of your query should appear in the dequeue window. -
Run
sbadmin shutdown. -
In the window running simpleserver, press Ctrl-C to stop the server.
