Comparing data sets with different measurements
$begingroup$
I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.
One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.
Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%
Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)
I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.
My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.
So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?
Thanks for any advice.
dataset statistics visualization data-cleaning descriptive-statistics
$endgroup$
bumped to the homepage by Community♦ 4 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.
One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.
Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%
Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)
I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.
My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.
So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?
Thanks for any advice.
dataset statistics visualization data-cleaning descriptive-statistics
$endgroup$
bumped to the homepage by Community♦ 4 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05
add a comment |
$begingroup$
I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.
One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.
Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%
Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)
I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.
My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.
So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?
Thanks for any advice.
dataset statistics visualization data-cleaning descriptive-statistics
$endgroup$
I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis.
One piece of data (https://www.pandasecurity.com/mediacenter/src/uploads/2014/07/Pandalabs-2015-anual-EN.pdf on page 9) it states that the 'infection rates' of Sweden is 20.88% (bottom 3 ranking), USA at 29.48% (middle ranking) and China (first rank) having 57.24%.
Another (http://www.virusradar.com/en/home/world) , uses a different measurement to define the 'threat rates', which is different to the one above, which has Sweden at 2.13%, US at 2.87%, and China at 15.17%
Another piece of data (https://www.symantec.com/content/dam/symantec/docs/reports/istr-22-2017-en.pdf
on page 50) states 'identity theft' in Sweden is 6 million(low ranking), US 791 million (high ranking), and China 11 million (middle ranking)
I'm unsure how to compare these, because by just looking with our eyes we can see Sweden is the lowest in all these statistics which I can use to further discuss my argument. However, these are clearly different measurements (one is overall infections, one is just identity theft, etc), and I have much more similar data which provides numbers/percentages of certain types of cyber crime by country.
My goal is to analyse the results so I can compare them to further the goals of the thesis about where cyber crime is most/least prominent and to create visualisations of this.
So would just simply ranking them be fine? (Sweden 3 because it was lowest all times?, USA 2 because it was second twice?, China 1 because it was first twice?) but that sounds very incorrect. Should I convert all my numeric data sets (like the identity theft one) to percentages then compare them all by percentage to rank/discuss accordingly? And compare them then even though they're different measurements of the same thing(country)?
Thanks for any advice.
dataset statistics visualization data-cleaning descriptive-statistics
dataset statistics visualization data-cleaning descriptive-statistics
edited Mar 13 '18 at 23:03
O B
asked Mar 13 '18 at 22:48
O BO B
11
11
bumped to the homepage by Community♦ 4 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 4 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05
add a comment |
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.
But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.
Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.
You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.
Cheers
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f29049%2fcomparing-data-sets-with-different-measurements%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.
But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.
Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.
You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.
Cheers
$endgroup$
add a comment |
$begingroup$
You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.
But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.
Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.
You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.
Cheers
$endgroup$
add a comment |
$begingroup$
You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.
But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.
Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.
You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.
Cheers
$endgroup$
You're right, you cannot directly compare the scores, since they are extracted from different samples, using different metrics and parameters, etc. Is exactly as comparing apples with airplanes.
But is not so wrong to play around with the placement in the rank: you are comparing placements with placements, so it makes perfectly sense. If Sweden is always at the last place, this definitely means something.
Maybe you can also think of weight those placements by some parameter/set of parameters which takes in account the subject of the ranks.
As example, seriousness of the threats (ex. infection by AdWare can be less important than identity theft, etc), coverage of the population by the authority which published the results, reputation of the authority, etc.
You can also extract uncertainties on those ranks, maybe based on the statistical samples taken in account by the authorities, and so on.
Cheers
answered Mar 14 '18 at 14:56
Vincenzo LavoriniVincenzo Lavorini
1,314417
1,314417
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f29049%2fcomparing-data-sets-with-different-measurements%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Scaling might help otherwise you can't compare
$endgroup$
– Aditya
Mar 14 '18 at 0:38
$begingroup$
Look into (ordinal) rank aggregation. Welcome to the site!
$endgroup$
– Emre
Jun 12 '18 at 17:05