top of page

Minds UI - Guidance

We know you want to make the most out of your brain activity. We'll help. Here's general guidance and documentation on using the MindsApplied Neural User Interface

 We are so grateful you are testingout our applications but please understand, this technology is still developing so it will take some time and occasional troubleshooting, but the results are well worth the wait.  We’re excited to guide you on this journey through this page, however if you need more help please leave a review in the Feedback section at the bottom of minds-applied.com/minds-ui .

 

Please carefully follow the steps in this User Guide as we save intervals of neural activity corresponding to your imagination of various words and tasks. This technology has been shared with you given the advancements your team has shown in the fields of artificial intelligence and or neurotechnology. These are experimental applications MindsApplied is working to improve with the introduction of models created through our Crypt Algorithm. Unless told otherwise, please assume this technology is meant to leverage the advancements of your own AI, using your own models and training methods (more information in section E).

 

The Minds UI connects to a variety of brain-computer interfaces to record neural data for purposes of artificial intelligence and test commercial neurotechnology applications. Models trained are meant to recognize the same patterns of brain activity and predict the thought or action you are most likely thinking. We leverage these models in our real-world applications Cognichat and Cognitrol. When applied towards communication, control, or mental health, the possibilities of what you’ll be able to do with neurotechnology are endless. If you have any questions, please reach out to our team via any previous correspondence or contact@minds-applied.com.

 

Read Me:

 

  • The Minds UI will take up a full screen. We recommended having a secondary monitor so that you can access your file system while the application is running on the main screen. This will be useful when you TEST FILE SAVING

 

  • We recommend that you have someone else present with you to verify that your BCI headset is functioning properly. If this is not possible, please contact our team to schedule one of our teammates to help with device verification. For experienced users, it is possible to perform calibration without any assistance.

 

  • This calibration activity should be performed in a distraction-free environment. DO NOT perform this in a public place. Please proceed to a quiet, private room that does not have any noises, visual distractions or strong scents. We understand that this may not be completely possible, however, the most important thing is to ensure there are no sound distractions. Since we will be reading your mind to translate into speech, any noises you hear may contaminate your telepathic data.

 

  • Make sure you are comfortable. We recommended a comfortable chair or a seat on the floor. It’s also important to avoid moving as much as possible, as this may also contaminate your telepathic data. 

 

  • Make sure you are not tired. If you fall asleep at all, the data will be skewed.

    • Please let us know if you fall asleep on any trials or if any other distractions were present during them.

    • There will be times to make notes during the intermissions. There’s no need to make notes during other parts of the calibration. Sit back and enjoy the calibration!

  • You can press the escape button (ESC) at any moment to pause the interface and return to the main menu. You can press the MindsApplied logo in the top left to go back.

 

  • Please carefully read the entirety of this User Guide before starting the application. We know everyone hates reading long documents, so we made this as short as possible so that you can quickly start your journey towards using Neuroscience as a Service! At Minds Applied we believe your data is important and want to ensure you have no trouble outputting your thoughts. 

 

A) PREPARATION

 

  1. Download the application from minds-applied.com/minds-ui or a link provided by our team.

  2. Unzip the file and application icon to an easily accessible folder (e.g. C:\Users\) 

  3. Put an EEG or other BCI headset on your head according to the manufacturer's instructions. If a gel or saline solution is supposed to be used with your headset, please make sure this step is followed. However, be aware that commercial usage of such a gel may be less than desirable.

  4. Verify that all channels are functioning properly. To test this, use the GUI that is recommended by the manufacturer of your headset. We recommend experimenting with a different number of channels or according to the latest research.

  5. If the signal quality is poor on any electrode channel, use a 0.9% saline solution to clean the electrode contacts.

  6. Retry the channel verification test using the appropriate GUI.

  7. Once you have verified that your device is functioning as expected, you are ready to begin your journey of telepathy!

  • If any channels are not functioning as expected, please make a note of this information and pass it along to our team members for consideration during data analysis.


 

B) START DATA STREAM

 

  1. Open ProjectCrypt_Intake.exe

    • Note: Your computer’s security may attempt to block this file from running. You can disregard this message and run the file anyway.

  2. From the main Minds UI screen, find the Configuration section and then the Board Settings button.

  3. Do not press the Synthetic Signal button.

  4. Choose your brain-computer interface (BCI) board from the drop down menu.

    • If your device is not listed, please leave a Feedback review or reach out to a member of our team and we will try to include it in a future release or special accommodation. 

  5. If you are using a USB dongle, select the appropriate COM port for your BCI. Disregard this step if your headset is connected without a USB dongle.


 

C) TEST FILE SAVING

 

Let’s do a quick test run to ensure your neural data is saving properly. The last thing we want is for you to spend your time recording your brain activity only to realize it wasn’t actually stored - awkward. We know you’re busy, but this short step will make sure we don’t waste your valuable time. Bear with us.

 

  1. Start after Step #5 from START DATA STREAM.

  2. Enter your preferred or provided subject ID. This is in the format of S##, such as S01.

  3. Since this is just a test, please enter ‘Test’ in the Session field. During the actual calibration you will input the real session number.

  4. To start the data intake, please press the green Connect button once

    • If successful, the button will change to red and will display Connection Successeful

    • If the connection was unsuccessful, press the X on the right and try again.

    • If you still cannot connect, try moving closer, restarting the application, and or ensure your headset’s connection is stable.

    • If needed, a member of our team can assist you.

  5. Once your BCI device is connected, the data intake has started.

  6. Allow the recording to run for a few seconds.

  7. Press the Disconnect button to stop the recording. The button will turn white once you press it.

  8. To locate the Cognichat main folder directory, return to the Configuration screen and press the Saved Recordings button. This will open the directory in your computer’s file explorer. You can skip this step if you know the folder location.

  9. Once you have navigated to the appropriate folder, there should be an excel file created with the name EEG. If this file has been created and is larger than 0 MB in size, everything is working correctly and you’re all set to start! Please proceed to the next section D) BEGIN FILE SAVING to begin your telepathy calibration!

  10. If there is no excel file named ‘EEG’ created, please retry TEST FILE SAVING: Steps # 1-11 again. Hopefully, this time everything checks out and you're all set to move onto the next steps! If for some reason, this file still cannot be located, please reach out to our team and we’ll fix this issue right away.

 

D) BEGIN FILE SAVING

 

  1. Start after Step #5 from START DATA STREAM.

  2. Enter your Subject ID. This may have been provided to you by our team in the format S-##.

  3. If this is your first session, please enter ‘001’ in the Session field. Each time you start a new session, please make sure to update the Session value appropriately. Also, make sure your Subject ID is still correct.

  4. When you are ready to proceed, please press the green Connect button

    • If successful, the button will change to red and will display Disconnect and or a notification will appear.

    • If the connection was unsuccessful, press the X on the right and try again.

    • If you still cannot connect, try restarting the application and trying again or get in contact with a member of our team.

  5. Once your BCI  is connected, the data intake has started. It’s important to not leave your computer to pause, as your brainwaves are continuously being recorded and stored until you disconnect your EEG device at the end of the session.

  6. Press the back arrow button at the top of the screen.

 

D1) BEGIN RECORDING CALIBRATION

 

In this section, we will save segments of your neural activity associated with the words you think (a trial) so that a model of prediction can be trained on the data. Once you begin, please keep your eyes directed at the middle of the screen for the duration of the calibration. It will take roughly 2 minutes per block (not including intermission), and each block has 2 parts. The more trials you perform the better predictive accuracy of our solutions.

 

  1. Be sure to turn off any noise by selecting the Sound button in the bottom right of the UI.

  2. Select the Calibration page.

  3. From here you are able to choose the different categories of words through which you would like to communicate. We recommend selecting all the categories available to you for recording. As a note, each of these categories will need to have their own models generated. We reduce the number of words per model to improve predictive accuracy. This will make sense once we get to Cognichat.

  4. When you are ready, press Train Words to begin.

  5. A word will briefly appear in the middle of the screen. Remember this word.

  6. Immediately after it disappears, a plus sign will appear in the middle of the screen and only for about 2 seconds, depending on the length of the word.

  7. Once the plus sign appears, using only your mind, think of the previous word once.

    • Try not to say the words out loud or make movements (jaw, head shaking etc.) as this movement will contaminate your brainwaves.

  8. The plus sign will disappear and a new word will appear on screen. Repeat steps 1-3 of this section for each new word that appears on screen.

  9. There will be an intermission at the midpoint of the Calibration that says Start Next Block.

    • Take this time to write down any notes that you think will be relevant to our team and during which words (falling asleep, headset knocked, etc)

    • Please don’t leave your desk. Remember your brainwaves are still being collected.

    • You’re halfway done! That wasn’t so bad was it? Let’s finish the second half now!

  10. When you’re ready, press the Start Next Block button to start the second half of the training exercise.

  11. The second half follows the same format as the first half. Goodluck!

  12. Once the training has finished, you will see a button reading Calibration Finished appear on the screen.

  13. Stop the Calibration and return to the main menu. Verify the Data has stopped recording using method D2 below. If data seems to continue saving beyond the experiment, disconnect on the Configuration screen or Close the application by exiting or clicking the Quit button on the Minds UI screen.

 

D2) VERIFY SAVED DATA INTEGRITY

 

Congrats! You’ve taken the first step to harnessing your neural data! Exciting isn’t it!? Let’s quickly check to make sure your valuable brain activity has been stored properly. We recommend repeating this step after every trial, particularly if you believe something may have interfered with any aspect (be it the connection, an error, or buffering may all be a sign of flawed intake)

  1. return to the Configuration screen and press the Saved Recordings button. This will open the directory in your computer’s file explorer. Reference TEST FILE SAVING for file naming conventions.

  2. Once you have navigated to the appropriate folder, just like when you checked the test file, there should be an excel file created with the name EEG. If this file has been created and ranges between 15-30 MB in size, everything was recorded correctly!

  3. If your EEG file is a lot smaller, there was likely an issue with the recording (save issues, interruption, etc.) Unfortunately, we will need to redo the individual Calibration trial.

  4. If the file is larger, you most likely left the recording running for too long. Please follow step BEGIN CALIBRATION more closely.

  5. When you redo the recording, start a new session by incrementing the Session number by one (e.g. Session 2). Follow the same instructions as above.

    • If you still have issues, contact a member of our team.


 

E) Data Analysis and Model Uploading

Now that you’ve saved the necessary data, you are able to train your own models or join the waitlist for one provided by our Crypt Algorithm. Models can be trained via neural networks like EEGNet, EEG-Conformer and more. We currently only support live predictive models generated via ONNX format. If a model is not uploaded for any category , a random variable will be pulled from our Predictionary ((more below), for purposes of testing the application (but it's much cooler if you use AI).

  1. Models can be uploaded via the Configurations menu by selecting the button Model Loading. This will highlight the required ONNX file folder.

  2. Models need to follow the naming format of MindsUI_Model_Category. For example: MindsUI_Model_Directions.

  3. Cogntrol requires at least the above trained model to leverage directional activity. Cognichat requires models from Directions, Emotions, Time, and Confirmation.

  4. Below are the Thought Categories and their associated Calibration words:

 

 

 

 

 

 

 

 

 

 

 

 



 

 

*These words are not included in the current iteration of Cognitrol and while they may be included in the model, currently they will only be used for predictive purposes in Cognichat.
 

F1) REAL TIME PREDICTION - Cognichat

 

As any sensei will tell you: “Now it’s time to put your training to the test!”

Using your uploaded models, Cognichat (patent pending) combines individual thought word prediction with Natural Language Processing to send full thoughts as text messages. If you do not upload a model, a random but applicable word will be chosen for testing purposes. Simply enter the phone number from which you want your BCI to communicate and off you go. Have your partner ask questions which can be answered by using just the above individual thought words like the below example conversations (We’re constantly working to expand these). There are 5 questions allowed, then you will be required to pause and return to the main menu.

 

Here is where we will apply what we call Cognispeak: thinking in a way that allows your mind to best be read. Similar to the Calibration, you will think in one word responses using the thoughts above and which you have recorded/trained on. Cognichat will do the rest; taking your partners asked question in combination with the 2 second predicted response you are thinking and Bam! Telepathy: 

 

Example Conversations(Question, Thought, Response)

Q: How are you feeling today?

T: “Happy”

R: I am feeling happy.

 

Q: Which direction did you go?

T: "Right"

R: Previously, I went right.


 

  1. Navigate to the button Cognichat.

  2. Accept the terms, enter your phone number who has given you consent to message them and press the Start button. Welcome to Cognichat will appear in the center of the screen.

    • Cognichat requires stable internet connections and can be prevented from sending messages due to vpns, firewalls or other interference.

  3. Press the What’s Your Question? button when you are ready.

  4. Your partner has 20 seconds to text a question (we’re working to make this more seamless).

  5. After you read the question the ‘+’ will appear in the center of the screen.

  6. During this 2 second interval, you are meant to leverage Cognispeak by thinking your one word response from the thought words you trained on.

  7. After, a complete sentence will be sent back to your partner.

  8. Repeat or reload the application as many times as you would like and to as many phone numbers.  

  9. Now that you’re all done, you can close the application. To do so, press the Esc button on your keyboard and press Back to Menu on screen. Then press the back arrow at the top of the screen, and press Quit.

 

Like all neurotechnology, we’re still working to improve and expand upon Cognichat. We want to use more of the conversation history, location, and general user data to better formulate responses as actual predictions become more accurate. However, the MindsUI is meant to demonstrate the capabilities of this technology. The end goal is for us to work with you to decide where to best  integrate it. Whether it be video games, mobile devices, or healthcare, Cognichat shows the possibilities of improving upon all forms of communication. 

 

F2) REAL TIME PREDICTION - Cognitrol

 

Cognitrol (patent pending) leverages various neural activities such as inner speech or motor imagery, to steer a spaceship. Unlike Cognichat, it only makes use of one thought category: directions.  If you do not upload a model, a random but applicable direction word will be chosen for testing purposes. When the ship gets too far from the screen, it will reset to the center despite the prediction. There are directional steers allowed, then you will be required to pause and return to the main menu.

 

  1. Navigate to the button Cognitrol.

  2. Press the Start button. Welcome to Cognitrol  will appear in the center of the screen.

  3. The application will start automatically.

  4. Similarly to the Calibration and Cognitrol applications, a ‘+’ will appear for 2 seconds on the screen in repetition of about 5 second intervals.

    • If using a different mode of neural control, please defer to that method.

  5. The ship will move in the direction predicted. 

  6. Repeat or reload the application as many times as you would like and to as many numbers.  

  7. Now that you’re all done, you can close the application. To do so, press the Esc button on your keyboard and press Back to Menu on screen. Then press the back arrow at the top of the screen, and press Quit.

 

Like the previous applications, we’re still working to improve and expand upon Cognichat. We want to introduce various types of neural control to see what works best for any individuals. We also will be expanding upon the application to navigate around obstacles. But, once again, the application is meant to demonstrate the capabilities of this technology. The end goal is to make the technology work in commercial scenarios like controlling machinery, or simply turning off lightswitches and opening doors. Whether it be video games, transportation, robotic manipulation, Cognitrol shows the possibilities of improving upon all forms of control and interaction! 

 

Where would you apply these Configuration, Calibration, Cognichat and Cognitrol technologies? Visit our contact page to let us know how you would apply your mind.

 

Troubleshooting:

 

  • EEG device not connecting properly?

    • Ensure your device is in close enough proximity to connect with your USB dongle or computer

    • Try disconnecting and reconnecting  your device with your computer

    • Still not working? Double check the troubleshooting documentation from your device manufacturer

    • Contact our team for help

  • Cognichat not sending or receiving messages?

    • This can be due to web connection interference like internet quality, vpns, or firewalls. Try the application in various locations or with different wifi/cellular connections. 

    • Test the application using different phone numbers, certain regions or numbers may not be available.

    • Contact our team with the methods that don’t work for you and we will try to address them in one of our upcoming releases.

Thought Predictionary

Feedback

Let us know what you think

Thanks for submitting! We'll get to your feedback as soon as possible. 

bottom of page