Skip to content

Adding Simple Recurrent Unit as a recurrent layer #2408

@Jafagervik

Description

@Jafagervik

Motivation and description

The recurrent.jl file already has implementations for RNN, LSTM and GRU layer, and I'm starting to work on implementing my own SRU to use in Julia as well. Its based on this paper. I thought this could be of general usage as well

Possible Implementation

I don't have any code yet so far for it, so heres the attached pseudocode for a single layer:

1711203661

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions