System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On the relationship between hyperparameters and Mode Collapse in GANs
Jönköping University, School of Engineering, JTH, Department of Computing, Jönköping AI Lab (JAIL).
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesisAlternative title
Om relationen mellan hyperparametrar och Mode Collapse i GANs (Swedish)
Abstract [en]

The current research into the issue known as mode collapse has underrepresented the relationship between hyperparameters and mode collapse in GANs. This study aimed to research this further by investigating the effects of four prominent hyperparameters on the manifestation of mode collapse in unconditioned and conditional DCGANs. The investigation was performed via the use of quasi-experiments where the independent variables were the four hyperparameters and the dependent variable was the FID score. Supplemental evaluation was also done by counting classes present with classifiers and visual inspections. The results showed that the number of epochs and the size of the latent dimension only displayed signs of mode collapse at impractically low values. Meanwhile, the learning rate and batch size both had a large effect on mode collapse for higher values. The results showed no significant differences in the hyperparameters’ effect on mode collapse between the unconditioned and conditional DCGANs. The main exception was that the conditional DCGANs were more unstable during training. The conditional DCGANs also occasionally were seen to suffer a phenomenon this study refers to as training failure rebound. This phenomenon had a strong effect on the outputs of the models and is potentially a valuable avenue for future research.

Place, publisher, year, edition, pages
2024. , p. 45
Keywords [en]
Generative Adversarial Networks, Deep Convolutional Generative Adversarial Networks, Mode Collapse, Hyperparameters, Instability, Fréchet Inception Distance
National Category
Computer Systems Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:hj:diva-65775OAI: oai:DiVA.org:hj-65775DiVA, id: diva2:1886001
Subject / course
JTH, Computer Engineering
Supervisors
Examiners
Available from: 2024-08-12 Created: 2024-07-29 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

fulltext(973 kB)583 downloads
File information
File name FULLTEXT01.pdfFile size 973 kBChecksum SHA-512
3636f935fe8b0c388dd130da3af24625747afa89501402ea98287349943ec70212792c5d071a149ead2eb301818d193c82371a4c8f8b86a8c32c27cfd489d4a1
Type fulltextMimetype application/pdf

By organisation
Jönköping AI Lab (JAIL)
Computer SystemsOther Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 585 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 442 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf