Newer
Older
masterarbeit / text / thesis / 04Discussion.tex
@Jan-Peter Hohloch Jan-Peter Hohloch on 14 Nov 2016 6 KB work on thesis - discussion on confusion matrices
\chapter{Discussion}
\section{EMG}
\label{dis:emg}
    Predictions of velocities and positions are quite bad from EMG.
    The prediction of the $y$-dimension is a bit better than $x$ ($p<0.05$) for velocities. For positions there is no significant difference ($p\approx 0.31$). Predicting $\theta$ is worse significantly ($p<0.001$) for positions and velocities (also see tables \ref{tab:corrKin} and \ref{tab:corrPos}). %Results?

    A correlation about $0.2$ cannot be used for a BCI. There might be some way of improving the predictions and it might be done several times to higher the correlations, finding another approach however is more promising.\\
    In addition when a BCI is needed often the are no EMG signals since the muscles do not work as they are told (e.g. after stroke) and so do not generate the corresponding activity.

    Out of these reasons we only use EMG as benchmark for other approaches: If the muscles would work this correlation could be reached.
\section{EEG}
\label{dis:eeg}
    Predictions from EEG to velocities and position are significantly better than those from EMG (see tables \ref{tab:pCorr},~\ref{tab:corrKin},~\ref{tab:pCorrPos} and \ref{tab:corrPos}).\\
    This might be because EMG has a hard time classifying the different movements due to massive activity while moving. This can be seen in the confusion matrix (\ref{fig:cmEMG}). Many data points belonging to class 2 or 4 are classified as 3 in error. The classification between movement and rest however works fine.\\
    All in all few samples are classified as class 2 even though the training was done on a balanced set. This %TODO really?
    could mean that features of class 2 are found in other classes too and by that do not have strong predictive power.

    When predicting velocities or positions from EEG there is no significant difference between $x$ and $y$. The difference between $x$ and $y$ and the angle $\theta$ is larger for velocities than for absolute positions since the absolute angle prediction a lot better than the prediction of change.\\
    This again is an indication that the actual position is more important for the activity in brain than the change of position as itself.
\section{Low Frequencies}
\label{dis:lf}
    Our findings concerning low frequencies are a lot less promising than e.g. in \cite{Lew14}.\\
    The reason for that might be that the movements were not self induced but extrinsically motivated by a cue. \citeauthor{Lew14} however use low frequencies exactly for the purpose to detect voluntary movement.\\
    We show that the use of low frequencies (at least as we did it here) has no advantage over the use of EMG (see table \ref{tab:pCorr}). This might also be a hint that movement relics were have the biggest part in low frequencies while moving. This however makes it impossible to use them for continuous tasks.\\
    Low frequencies are great to early detect voluntary movement but are not applicable in our configuration.

    Which is interesting nevertheless is, that low frequencies also occur in rest. Quite some of the movements are classified as rest (see figure \ref{fig:cmEEG}). If a sample is classified correctly as movement it is quite likely that is is also classified correctly - however with an preference on class 3 again. %TODO - naja
\section{Velocities and Positions}
\label{dis:velPos}
    We expected better performance when predicting velocities instead of absolute positions. Our findings however show the opposite. The performance is quite a lot better when predicting positions directly.\\
    This might mean that both EMG and EEG data carry more information about the actual configuration and not only about the change.
    %TODO: reason?
\section{Pause}
\label{dis:pause}
    The use of a 1 second pause before movement onset only shows significant differences for classification of EMG and predicting Synergies from low frequencies.
    \subsection{Classification from EMG}
        When doing classification from EMG data there is an great improvement when leaving the whole second before movement onset out. This results from the way we did the classification. Since we decided on when the movement starts based on the EMG data.\\
        What this finding shows is that the threshold is chosen well to classify the movements.
    \subsection{Synergies from Low Frequencies}
        There is a significant improvement for predicting Synergies from low frequency data. This shows again what \cite{Lew14} proposed; in low frequency features we find mainly pre-movement activation. Activity while moving is probably mostly occluded by motor commands.
\section{Offset}
\label{dis:offset}
    Applying an offset when using EEG-data or not does not make a significant difference. This is probably due to our configuration with EEG windows as large as 1 second. If smaller windows were used an offset could help, here there is no difference.
\section{Synergies}
\label{dis:synergies}
    \subsection{Number of Synergies}
    \label{dis:noSyn}
        As shown in section~\ref{res:noSyn} 2 and 4 Synergies are good values for Autoencoder since the slope of the mean prediction is steeper before than after. Another neuron doesn't improve the result as much as the last.\\
        For PCA and NNMF this value is reached at 3 as figure \ref{fig:noSyn} shows.
        %TODO: 2, 4
        % Autoencoder better when having fewer synergies(?)
    \subsection{Autoencoder, PCA or NMF}
    %TODO
    \subsection{Prediction via Synergies}
        Of course the prediction via Synergies is a bit worse than direct prediction, since the machine learning techniques could do the same dimensionality reduction and also much more.\\
        Nevertheless we also get good correlations when predicting from synergies meaning the model may match the reality. %TODO formulierung?
        In addition synergies are predicted significantly ($p<0.05$) better from EEG than EMG. So the representation as synergies probably matches the representation in the brain better. This could mean that the controlling of a prostheses should be done via synergies - representing the representation in the brain and being easier to implement than a prosthesis listening to 32 EEG channels.
    \subsection{Comparison with EMG}
        The results show that the dimensionality reduction from 6 dimensional EMG to 3 dimensional Synergies (here via autoencoder) does not cost much information when predicting velocities and positions.\\
        For velocities there is no significant difference and even for positions the mean only differs about $0.03$ (EMG: $0.23$, Autoencoder: $0.20$).