Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiments about self negative sampling #11

Closed
yiranyyu opened this issue Mar 10, 2022 · 1 comment
Closed

Experiments about self negative sampling #11

yiranyyu opened this issue Mar 10, 2022 · 1 comment

Comments

@yiranyyu
Copy link

I have some questions about the experiments of self negative sampling.

  1. In Table 4, the results show that removing self negative sampling can hurt the performance. Have you tried to sample negative entities from both the Gx and Gy?
  2. Since the alignment accuracy are quite good on the examined datasets, have you tried to reduce the number of conflicts when sampling from another KG using the alignment result?
@HaoyunHong
Copy link
Collaborator

Hi @yiranyyu

Thanks for your good questions!

For the first question, we don’t think it’s necessary to sample from both the KGs, because, just as you said, negative samples from the other KG that can be false negatives, will hurt the performance, which is also explained in the third paragraph of Section 4.2 of our paper. Therefore, it’s better to merely sample from the same KG, i.e., self negative sampling, to guarantee the performance in our self-supervised setting.

For the second question, if the “alignment result” you said means the alignment labels, we have done experiments, which is in Section 4.3 of our paper. If the “alignment result” you said means the alignment pseudo labels in the training process, we have tried an algorithm similar to a method called self-training, but the result is not as good as SelfKG, which may results from the error cascades.

@HaoyunHong HaoyunHong pinned this issue Mar 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants