Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enumerable Label not supported. #28

Open
ChewyMoon opened this issue Jun 5, 2015 · 10 comments
Open

Enumerable Label not supported. #28

ChewyMoon opened this issue Jun 5, 2015 · 10 comments

Comments

@ChewyMoon
Copy link

Any label that implements the IEnumerable will throw exceptions saying that it needs to have the EnumerableFeature attribute, when I need a Label, not a Feature.

@sethjuarez
Copy link
Owner

Great question. In this case the machine learning problem will not accept a multi-valued output (hence no support for en EnumerableLabel). What are you trying to accomplish? Maybe I've made a mistake somewhere.

@ChewyMoon
Copy link
Author

I do think at least a vector output should be supported.

@normanhh3
Copy link

I don't think the intent is to make any arbitrary graph into a potentially
significantly sparse array of vectors. Or am I missing something too?
On Jun 11, 2015 10:24 AM, "Justin" [email protected] wrote:

I do think at least a vector output should be supported.


Reply to this email directly or view it on GitHub
#28 (comment).

@sethjuarez
Copy link
Owner

@ChewyMoon I'm interested in a use case. I might be missing something (maybe it's something we should support).

@bdschrisk
Copy link
Collaborator

Just saw this, a use case would be learning sequences. Such as in one to many or many to many recurrent neural nets.

@sethjuarez
Copy link
Owner

Sounds good. A couple of things moving forward:

  • We need to come up with a way for the learner to select the appropriate IGenerator given the label (for example, the only true multi-class learner implemented so far is the DT)
  • Any suggestions for a sequence learning algorithm?

@bdschrisk
Copy link
Collaborator

I'm nearly finished with SVM, scoring, multi-class learning (it handles unlimited classes, with support for using any generator and is parallelised by n classes), recommendation (collaborative filtering) and started with recurrent neural nets. It should be fairly straight forward to implement sequence learning as all you are doing is changing the predicted output to a vector and the vector size would be set from either a labelenumerable attribute or the size of the output layer in a neural net.

@sethjuarez
Copy link
Owner

OK - we should meet about the code. Some of the previous stuff we've merged seems to duplicate some of the other math structures available. Maybe we should have a face-to-face to make sure I am understanding properly. I also want to move to a unified data structure for all models (some graph type data structures). What do you think? Perhaps we should move the convo to gitter:

Join the chat at https://gitter.im/sethjuarez/numl

@bdschrisk
Copy link
Collaborator

Reopening issue.

@bdschrisk
Copy link
Collaborator

This is partially implemented, see ISequenceModel and Neural Networks.

We need to discuss for other algorithms...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants