Skip to content

L-BFGS for style transfer #127

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nsthorat opened this issue Apr 6, 2018 · 2 comments
Closed

L-BFGS for style transfer #127

nsthorat opened this issue Apr 6, 2018 · 2 comments
Labels

Comments

@nsthorat
Copy link
Contributor

nsthorat commented Apr 6, 2018

From @carlthome on February 15, 2018 23:11

Fast style transfer with pretrained models is really cool, but the original optimization-based method presented by Gatys et al. seems like such a great fit for what deeplearn.js could provide with its WebGL integration and builtin gradient computation.

I'd really like to make interactive style transfer web apps but there's no L-BFGS optimizer in deeplearn.js. Is that a planned addition or will you focus on SGD variants?

Copied from original issue: tensorflow/tfjs-core#734

@nsthorat nsthorat added the api label Apr 6, 2018
@nsthorat
Copy link
Contributor Author

nsthorat commented Apr 6, 2018

Currently we're only focusing on SGD variants of optimizers, but if you are interested in making an L-BFGS, 2nd order gradient based optimizer you can either

  1. extend the Optimizer base class and override computeGradients, and applyGradients
    or
  2. simply write your own optimizer without using the Optimizer class. You can compute gradients with the eager style method of differentiation (use methods from this section and then use dl.variable() and variable.assign() to do an update.

If you decide you're up for it, let us know if you run into any issues!

@rthadur
Copy link
Contributor

rthadur commented Mar 6, 2020

Automatically closing due to lack of recent activity. Please update the issue when new information becomes available, and we will reopen the issue. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants