Do I use actual data or data difference to train machine learning model?
$begingroup$
I would like to predict tomorrows temperature :-).
But I'm unsure of the best approach. Do I simply drop data from the last x days, or do I try do drop data from the last x days in difference?
Last three days could look like: 21.3C, 22C, 21.9C
Where the difference is whatever previous, 0.7C, -0.1C
You would need more than 3 days, I'm just setting an data example. I think I also would need to insert season among other variables to complete the experiment. But I'm just asking for temperature here.
Have anyone checked this? While the temperature can be anything from -20 to 40 C with decimals (1, 0.x) makes up a lot of numbers! But with difference the range is maybe -5C to +5C, also with decimals (1, 0.x) but it beats the other range making the range smaller and therefor easier for ML to predict?
If difference is best, should I also do percentage difference since then I would take to account different climate has different swings?
machine-learning machine-learning-model
asked Oct 15 '18 at 8:57
fUriousfUrious
61
$endgroup$
bumped to the homepage by Community♦ 5 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I would like to predict tomorrows temperature :-).
But I'm unsure of the best approach. Do I simply drop data from the last x days, or do I try do drop data from the last x days in difference?
Last three days could look like: 21.3C, 22C, 21.9C
Where the difference is whatever previous, 0.7C, -0.1C
You would need more than 3 days, I'm just setting an data example. I think I also would need to insert season among other variables to complete the experiment. But I'm just asking for temperature here.
Have anyone checked this? While the temperature can be anything from -20 to 40 C with decimals (1, 0.x) makes up a lot of numbers! But with difference the range is maybe -5C to +5C, also with decimals (1, 0.x) but it beats the other range making the range smaller and therefor easier for ML to predict?
If difference is best, should I also do percentage difference since then I would take to account different climate has different swings?
machine-learning machine-learning-model
asked Oct 15 '18 at 8:57
fUriousfUrious
61
$endgroup$
bumped to the homepage by Community♦ 5 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48
add a comment |
$begingroup$
I would like to predict tomorrows temperature :-).
But I'm unsure of the best approach. Do I simply drop data from the last x days, or do I try do drop data from the last x days in difference?
Last three days could look like: 21.3C, 22C, 21.9C
Where the difference is whatever previous, 0.7C, -0.1C
You would need more than 3 days, I'm just setting an data example. I think I also would need to insert season among other variables to complete the experiment. But I'm just asking for temperature here.
Have anyone checked this? While the temperature can be anything from -20 to 40 C with decimals (1, 0.x) makes up a lot of numbers! But with difference the range is maybe -5C to +5C, also with decimals (1, 0.x) but it beats the other range making the range smaller and therefor easier for ML to predict?
If difference is best, should I also do percentage difference since then I would take to account different climate has different swings?
machine-learning machine-learning-model
asked Oct 15 '18 at 8:57
fUriousfUrious
61
$endgroup$
I would like to predict tomorrows temperature :-).
But I'm unsure of the best approach. Do I simply drop data from the last x days, or do I try do drop data from the last x days in difference?
Last three days could look like: 21.3C, 22C, 21.9C
Where the difference is whatever previous, 0.7C, -0.1C
You would need more than 3 days, I'm just setting an data example. I think I also would need to insert season among other variables to complete the experiment. But I'm just asking for temperature here.
Have anyone checked this? While the temperature can be anything from -20 to 40 C with decimals (1, 0.x) makes up a lot of numbers! But with difference the range is maybe -5C to +5C, also with decimals (1, 0.x) but it beats the other range making the range smaller and therefor easier for ML to predict?
If difference is best, should I also do percentage difference since then I would take to account different climate has different swings?
machine-learning machine-learning-model
machine-learning machine-learning-model
asked Oct 15 '18 at 8:57
fUriousfUrious
61
asked Oct 15 '18 at 8:57
fUriousfUrious
61
asked Oct 15 '18 at 8:57
fUriousfUrious
61
asked Oct 15 '18 at 8:57
fUriousfUrious
61
asked Oct 15 '18 at 8:57
fUriousfUrious
61
61
bumped to the homepage by Community♦ 5 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 5 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48
add a comment |
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
I would use absolute temperatures. Knowing it's 37.2C, I'm more likely to say the temperature will decrease just from the context. This context would be lost if you only use the differences.
But like most data science questions, the proof is in the pudding. Try both and see what works best for you. You may even try using both absolute and difference as two feature columns.
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "557"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f39693%2fdo-i-use-actual-data-or-data-difference-to-train-machine-learning-model%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
I would use absolute temperatures. Knowing it's 37.2C, I'm more likely to say the temperature will decrease just from the context. This context would be lost if you only use the differences.
But like most data science questions, the proof is in the pudding. Try both and see what works best for you. You may even try using both absolute and difference as two feature columns.
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
$endgroup$
add a comment |
$begingroup$
I would use absolute temperatures. Knowing it's 37.2C, I'm more likely to say the temperature will decrease just from the context. This context would be lost if you only use the differences.
But like most data science questions, the proof is in the pudding. Try both and see what works best for you. You may even try using both absolute and difference as two feature columns.
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
$endgroup$
add a comment |
$begingroup$
I would use absolute temperatures. Knowing it's 37.2C, I'm more likely to say the temperature will decrease just from the context. This context would be lost if you only use the differences.
But like most data science questions, the proof is in the pudding. Try both and see what works best for you. You may even try using both absolute and difference as two feature columns.
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
$endgroup$
I would use absolute temperatures. Knowing it's 37.2C, I'm more likely to say the temperature will decrease just from the context. This context would be lost if you only use the differences.
But like most data science questions, the proof is in the pudding. Try both and see what works best for you. You may even try using both absolute and difference as two feature columns.
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
answered Oct 15 '18 at 15:36
kbrosekbrose
1,053313
1,053313
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f39693%2fdo-i-use-actual-data-or-data-difference-to-train-machine-learning-model%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Predict weather based solely on x previous temperatures (days, hours, etc.)? That's hard, but basically what you are describing is time series analysis.
$endgroup$
– user2974951
Oct 15 '18 at 9:36
$begingroup$
Time series analyses are not guaranteed to be hard. You can get pretty reasonable performance on temperature just by guessing tomorrow's temperature will be like today's temperature. Of course it will be nowhere close to state of the art, but far better than random.
$endgroup$
– kbrose
Oct 15 '18 at 15:48